2023-10-04 04:59:18,347 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-04 04:59:18,522 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17 2023-10-04 04:59:18,522 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-04 04:59:18,522 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-04 04:59:18,561 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-04 04:59:18,752 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-04 04:59:18,752 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e, deleteOnExit=true 2023-10-04 04:59:18,752 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-04 04:59:18,753 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/test.cache.data in system properties and HBase conf 2023-10-04 04:59:18,753 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 04:59:18,754 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop.log.dir in system properties and HBase conf 2023-10-04 04:59:18,754 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 04:59:18,755 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 04:59:18,755 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 04:59:18,990 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-04 04:59:18,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 04:59:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 04:59:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 04:59:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 04:59:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 04:59:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 04:59:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 04:59:18,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 04:59:18,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 04:59:18,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/nfs.dump.dir in system properties and HBase conf 2023-10-04 04:59:18,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir in system properties and HBase conf 2023-10-04 04:59:18,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 04:59:18,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 04:59:18,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-04 04:59:19,422 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 04:59:19,427 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 04:59:19,634 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-04 04:59:19,787 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-04 04:59:19,801 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:19,832 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:19,859 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_localhost_44679_hdfs____96w5aa/webapp 2023-10-04 04:59:19,972 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44679 2023-10-04 04:59:19,980 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 04:59:19,980 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 04:59:20,336 WARN [Listener at localhost/34757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 04:59:20,397 WARN [Listener at localhost/34757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 04:59:20,413 WARN [Listener at localhost/34757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:20,418 INFO [Listener at localhost/34757] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:20,423 INFO [Listener at localhost/34757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_localhost_33993_datanode____szb09m/webapp 2023-10-04 04:59:20,507 INFO [Listener at localhost/34757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33993 2023-10-04 04:59:20,864 WARN [Listener at localhost/34989] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 04:59:20,874 WARN [Listener at localhost/34989] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 04:59:20,878 WARN [Listener at localhost/34989] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:20,880 INFO [Listener at localhost/34989] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:20,885 INFO [Listener at localhost/34989] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_localhost_37569_datanode____xicj3v/webapp 2023-10-04 04:59:20,963 INFO [Listener at localhost/34989] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37569 2023-10-04 04:59:20,974 WARN [Listener at localhost/34347] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 04:59:20,991 WARN [Listener at localhost/34347] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 04:59:20,994 WARN [Listener at localhost/34347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:20,996 INFO [Listener at localhost/34347] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:21,004 INFO [Listener at localhost/34347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_localhost_43707_datanode____.doyr5m/webapp 2023-10-04 04:59:21,110 INFO [Listener at localhost/34347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43707 2023-10-04 04:59:21,125 WARN [Listener at localhost/41961] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 04:59:21,258 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b5a47a6c0683c64: Processing first storage report for DS-9bddc765-8250-42ab-be93-e1014a2dc11e from datanode 61d4b0f2-ae36-4fa7-b9d2-1942b40388cf 2023-10-04 04:59:21,259 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b5a47a6c0683c64: from storage DS-9bddc765-8250-42ab-be93-e1014a2dc11e node DatanodeRegistration(127.0.0.1:44043, datanodeUuid=61d4b0f2-ae36-4fa7-b9d2-1942b40388cf, infoPort=41651, infoSecurePort=0, ipcPort=34347, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,259 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce2cdf489369ac07: Processing first storage report for DS-cb040711-3714-4db4-9905-05c8c1cbdff3 from datanode 207abf18-f6c6-4c73-b21d-1de1b071ab70 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce2cdf489369ac07: from storage DS-cb040711-3714-4db4-9905-05c8c1cbdff3 node DatanodeRegistration(127.0.0.1:38567, datanodeUuid=207abf18-f6c6-4c73-b21d-1de1b071ab70, infoPort=39965, infoSecurePort=0, ipcPort=34989, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e1841a5874416a4: Processing first storage report for DS-d4be723d-1a26-4039-b127-0041637ce3a7 from datanode c7dc3ce1-d55b-4c2d-8f0c-467f123b29d4 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e1841a5874416a4: from storage DS-d4be723d-1a26-4039-b127-0041637ce3a7 node DatanodeRegistration(127.0.0.1:43123, datanodeUuid=c7dc3ce1-d55b-4c2d-8f0c-467f123b29d4, infoPort=39917, infoSecurePort=0, ipcPort=41961, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6b5a47a6c0683c64: Processing first storage report for DS-531f464d-720c-4d17-9c84-cb21596c5870 from datanode 61d4b0f2-ae36-4fa7-b9d2-1942b40388cf 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6b5a47a6c0683c64: from storage DS-531f464d-720c-4d17-9c84-cb21596c5870 node DatanodeRegistration(127.0.0.1:44043, datanodeUuid=61d4b0f2-ae36-4fa7-b9d2-1942b40388cf, infoPort=41651, infoSecurePort=0, ipcPort=34347, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce2cdf489369ac07: Processing first storage report for DS-1bd91f61-ddc6-4215-8e97-893024dd480d from datanode 207abf18-f6c6-4c73-b21d-1de1b071ab70 2023-10-04 04:59:21,260 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce2cdf489369ac07: from storage DS-1bd91f61-ddc6-4215-8e97-893024dd480d node DatanodeRegistration(127.0.0.1:38567, datanodeUuid=207abf18-f6c6-4c73-b21d-1de1b071ab70, infoPort=39965, infoSecurePort=0, ipcPort=34989, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,261 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3e1841a5874416a4: Processing first storage report for DS-d829f9d7-a3be-49d8-abb7-3989cfb41b25 from datanode c7dc3ce1-d55b-4c2d-8f0c-467f123b29d4 2023-10-04 04:59:21,261 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3e1841a5874416a4: from storage DS-d829f9d7-a3be-49d8-abb7-3989cfb41b25 node DatanodeRegistration(127.0.0.1:43123, datanodeUuid=c7dc3ce1-d55b-4c2d-8f0c-467f123b29d4, infoPort=39917, infoSecurePort=0, ipcPort=41961, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 04:59:21,481 DEBUG [Listener at localhost/41961] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17 2023-10-04 04:59:21,538 DEBUG [Listener at localhost/41961] zookeeper.MiniZooKeeperCluster(243): Failed binding ZK Server to client port: 60950 java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:461) at sun.nio.ch.Net.bind(Net.java:453) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:78) at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:687) at org.apache.zookeeper.server.ServerCnxnFactory.configure(ServerCnxnFactory.java:76) at org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster.startup(MiniZooKeeperCluster.java:239) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:129) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:102) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1090) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.setUpBeforeClass(TestMobSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-10-04 04:59:21,571 INFO [Listener at localhost/41961] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/zookeeper_0, clientPort=60951, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-04 04:59:21,589 INFO [Listener at localhost/41961] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60951 2023-10-04 04:59:21,601 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:21,604 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:22,226 INFO [Listener at localhost/41961] util.FSUtils(471): Created version file at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 with version=8 2023-10-04 04:59:22,227 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/hbase-staging 2023-10-04 04:59:22,505 INFO [Listener at localhost/41961] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-04 04:59:22,953 INFO [Listener at localhost/41961] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 04:59:22,979 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:22,979 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:22,980 INFO [Listener at localhost/41961] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 04:59:22,980 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:22,980 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 04:59:23,104 INFO [Listener at localhost/41961] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 04:59:23,166 DEBUG [Listener at localhost/41961] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-04 04:59:23,245 INFO [Listener at localhost/41961] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38813 2023-10-04 04:59:23,256 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,257 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,277 INFO [Listener at localhost/41961] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38813 connecting to ZooKeeper ensemble=127.0.0.1:60951 2023-10-04 04:59:23,320 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:388130x0, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 04:59:23,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38813-0x100fb50db750000 connected 2023-10-04 04:59:23,347 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 04:59:23,348 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 04:59:23,362 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 04:59:23,369 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38813 2023-10-04 04:59:23,370 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38813 2023-10-04 04:59:23,370 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38813 2023-10-04 04:59:23,371 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38813 2023-10-04 04:59:23,372 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38813 2023-10-04 04:59:23,377 INFO [Listener at localhost/41961] master.HMaster(444): hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, hbase.cluster.distributed=false 2023-10-04 04:59:23,432 INFO [Listener at localhost/41961] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 04:59:23,432 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,433 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,433 INFO [Listener at localhost/41961] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 04:59:23,433 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,433 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 04:59:23,437 INFO [Listener at localhost/41961] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 04:59:23,440 INFO [Listener at localhost/41961] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35697 2023-10-04 04:59:23,443 INFO [Listener at localhost/41961] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 04:59:23,449 INFO [Listener at localhost/41961] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 04:59:23,450 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,452 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,456 INFO [Listener at localhost/41961] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35697 connecting to ZooKeeper ensemble=127.0.0.1:60951 2023-10-04 04:59:23,461 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:356970x0, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 04:59:23,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35697-0x100fb50db750001 connected 2023-10-04 04:59:23,462 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 04:59:23,464 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 04:59:23,465 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 04:59:23,465 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35697 2023-10-04 04:59:23,465 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35697 2023-10-04 04:59:23,466 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35697 2023-10-04 04:59:23,470 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35697 2023-10-04 04:59:23,471 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35697 2023-10-04 04:59:23,482 INFO [Listener at localhost/41961] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 04:59:23,482 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,483 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,483 INFO [Listener at localhost/41961] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 04:59:23,484 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,484 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 04:59:23,484 INFO [Listener at localhost/41961] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 04:59:23,486 INFO [Listener at localhost/41961] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46127 2023-10-04 04:59:23,486 INFO [Listener at localhost/41961] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 04:59:23,488 INFO [Listener at localhost/41961] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 04:59:23,489 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,492 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,496 INFO [Listener at localhost/41961] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46127 connecting to ZooKeeper ensemble=127.0.0.1:60951 2023-10-04 04:59:23,501 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:461270x0, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 04:59:23,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46127-0x100fb50db750002 connected 2023-10-04 04:59:23,507 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 04:59:23,509 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 04:59:23,510 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 04:59:23,510 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46127 2023-10-04 04:59:23,514 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46127 2023-10-04 04:59:23,515 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46127 2023-10-04 04:59:23,516 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46127 2023-10-04 04:59:23,516 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46127 2023-10-04 04:59:23,529 INFO [Listener at localhost/41961] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-04 04:59:23,529 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,529 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,529 INFO [Listener at localhost/41961] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 04:59:23,529 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 04:59:23,530 INFO [Listener at localhost/41961] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 04:59:23,530 INFO [Listener at localhost/41961] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 04:59:23,531 INFO [Listener at localhost/41961] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41937 2023-10-04 04:59:23,532 INFO [Listener at localhost/41961] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 04:59:23,533 INFO [Listener at localhost/41961] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 04:59:23,534 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,535 INFO [Listener at localhost/41961] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,536 INFO [Listener at localhost/41961] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41937 connecting to ZooKeeper ensemble=127.0.0.1:60951 2023-10-04 04:59:23,541 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:419370x0, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 04:59:23,542 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:419370x0, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 04:59:23,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41937-0x100fb50db750003 connected 2023-10-04 04:59:23,543 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 04:59:23,544 DEBUG [Listener at localhost/41961] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 04:59:23,546 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41937 2023-10-04 04:59:23,546 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41937 2023-10-04 04:59:23,547 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41937 2023-10-04 04:59:23,547 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41937 2023-10-04 04:59:23,547 DEBUG [Listener at localhost/41961] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41937 2023-10-04 04:59:23,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:23,561 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 04:59:23,563 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:23,585 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 04:59:23,585 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 04:59:23,585 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 04:59:23,585 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 04:59:23,585 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:23,587 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 04:59:23,588 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,38813,1696395562368 from backup master directory 2023-10-04 04:59:23,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 04:59:23,596 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:23,596 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 04:59:23,597 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 04:59:23,597 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:23,600 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-04 04:59:23,602 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-04 04:59:23,693 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/hbase.id with ID: c6e5d888-6a09-4b63-80a3-930c0a124f74 2023-10-04 04:59:23,749 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 04:59:23,765 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:23,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x744fe6cd to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:23,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa14605, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:23,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 04:59:23,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-04 04:59:23,889 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-04 04:59:23,889 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-04 04:59:23,891 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 04:59:23,893 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 04:59:23,894 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 04:59:23,931 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store-tmp 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 04:59:23,972 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 04:59:23,972 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 04:59:23,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 04:59:23,974 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/WALs/jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:23,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38813%2C1696395562368, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/WALs/jenkins-hbase20.apache.org,38813,1696395562368, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/oldWALs, maxLogs=10 2023-10-04 04:59:24,051 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK] 2023-10-04 04:59:24,051 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK] 2023-10-04 04:59:24,051 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK] 2023-10-04 04:59:24,059 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-04 04:59:24,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/WALs/jenkins-hbase20.apache.org,38813,1696395562368/jenkins-hbase20.apache.org%2C38813%2C1696395562368.1696395564006 2023-10-04 04:59:24,125 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK], DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK], DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK]] 2023-10-04 04:59:24,126 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-04 04:59:24,127 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:24,130 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,194 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,202 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-04 04:59:24,237 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-04 04:59:24,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:24,258 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,260 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,280 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 04:59:24,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:24,288 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60121651, jitterRate=-0.10411758720874786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:24,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 04:59:24,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-04 04:59:24,317 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-04 04:59:24,317 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-04 04:59:24,320 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-04 04:59:24,322 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-04 04:59:24,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-10-04 04:59:24,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-04 04:59:24,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-04 04:59:24,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-04 04:59:24,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-04 04:59:24,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-04 04:59:24,433 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-04 04:59:24,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-04 04:59:24,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-04 04:59:24,446 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:24,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-04 04:59:24,449 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-04 04:59:24,466 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-04 04:59:24,470 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 04:59:24,470 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 04:59:24,470 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 04:59:24,470 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 04:59:24,471 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:24,471 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,38813,1696395562368, sessionid=0x100fb50db750000, setting cluster-up flag (Was=false) 2023-10-04 04:59:24,486 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:24,490 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-04 04:59:24,492 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:24,496 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:24,500 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-04 04:59:24,502 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:24,504 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp 2023-10-04 04:59:24,551 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(951): ClusterId : c6e5d888-6a09-4b63-80a3-930c0a124f74 2023-10-04 04:59:24,551 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(951): ClusterId : c6e5d888-6a09-4b63-80a3-930c0a124f74 2023-10-04 04:59:24,551 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(951): ClusterId : c6e5d888-6a09-4b63-80a3-930c0a124f74 2023-10-04 04:59:24,559 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 04:59:24,559 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 04:59:24,559 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 04:59:24,565 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 04:59:24,565 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 04:59:24,565 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 04:59:24,565 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 04:59:24,565 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 04:59:24,565 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 04:59:24,570 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 04:59:24,572 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 04:59:24,574 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 04:59:24,576 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ReadOnlyZKClient(139): Connect 0x03a6c6eb to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:24,577 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ReadOnlyZKClient(139): Connect 0x4aa3133f to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:24,577 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ReadOnlyZKClient(139): Connect 0x3a18d4c9 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:24,609 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-04 04:59:24,613 DEBUG [RS:2;jenkins-hbase20:41937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f238ffb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:24,614 DEBUG [RS:2;jenkins-hbase20:41937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38dca2c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 04:59:24,614 DEBUG [RS:1;jenkins-hbase20:46127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53508c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:24,614 DEBUG [RS:1;jenkins-hbase20:46127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dd97210, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 04:59:24,614 DEBUG [RS:0;jenkins-hbase20:35697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6274a2bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:24,615 DEBUG [RS:0;jenkins-hbase20:35697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75baeb1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 04:59:24,615 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:24,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-04 04:59:24,633 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:41937 2023-10-04 04:59:24,633 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:46127 2023-10-04 04:59:24,637 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:35697 2023-10-04 04:59:24,638 INFO [RS:2;jenkins-hbase20:41937] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 04:59:24,638 INFO [RS:0;jenkins-hbase20:35697] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 04:59:24,638 INFO [RS:1;jenkins-hbase20:46127] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 04:59:24,639 INFO [RS:1;jenkins-hbase20:46127] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 04:59:24,639 INFO [RS:0;jenkins-hbase20:35697] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 04:59:24,639 INFO [RS:2;jenkins-hbase20:41937] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 04:59:24,639 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 04:59:24,639 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 04:59:24,639 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 04:59:24,640 INFO [RS:0;jenkins-hbase20:35697] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:24,641 INFO [RS:1;jenkins-hbase20:46127] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:24,641 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 04:59:24,640 INFO [RS:2;jenkins-hbase20:41937] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:24,641 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 04:59:24,641 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 04:59:24,644 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:35697, startcode=1696395563431 2023-10-04 04:59:24,644 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:41937, startcode=1696395563528 2023-10-04 04:59:24,644 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:46127, startcode=1696395563481 2023-10-04 04:59:24,661 DEBUG [RS:0;jenkins-hbase20:35697] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 04:59:24,661 DEBUG [RS:1;jenkins-hbase20:46127] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 04:59:24,661 DEBUG [RS:2;jenkins-hbase20:41937] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 04:59:24,709 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-04 04:59:24,710 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33051, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 04:59:24,710 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47121, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 04:59:24,710 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49519, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 04:59:24,718 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 04:59:24,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 04:59:24,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 04:59:24,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 04:59:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-04 04:59:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-04 04:59:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 04:59:24,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696395594725 2023-10-04 04:59:24,726 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 04:59:24,727 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 04:59:24,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-04 04:59:24,737 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 04:59:24,738 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-04 04:59:24,742 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-04 04:59:24,742 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 04:59:24,750 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-04 04:59:24,750 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-04 04:59:24,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-04 04:59:24,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-04 04:59:24,752 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 04:59:24,753 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,752 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 04:59:24,752 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 04:59:24,753 WARN [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 04:59:24,753 WARN [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 04:59:24,753 WARN [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 04:59:24,754 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-04 04:59:24,756 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-04 04:59:24,756 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-04 04:59:24,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-04 04:59:24,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-04 04:59:24,761 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696395564761,5,FailOnTimeoutGroup] 2023-10-04 04:59:24,761 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696395564761,5,FailOnTimeoutGroup] 2023-10-04 04:59:24,762 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,762 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-04 04:59:24,764 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,765 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,782 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:24,783 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:24,783 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:24,807 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:24,809 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 04:59:24,812 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/info 2023-10-04 04:59:24,813 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 04:59:24,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:24,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 04:59:24,817 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/rep_barrier 2023-10-04 04:59:24,818 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 04:59:24,818 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:24,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 04:59:24,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/table 2023-10-04 04:59:24,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 04:59:24,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:24,824 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740 2023-10-04 04:59:24,825 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740 2023-10-04 04:59:24,828 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 04:59:24,830 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 04:59:24,834 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:24,835 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65757066, jitterRate=-0.020143359899520874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 04:59:24,835 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 04:59:24,835 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 04:59:24,835 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 04:59:24,835 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 04:59:24,836 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 04:59:24,836 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 04:59:24,837 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 04:59:24,838 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 04:59:24,843 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 04:59:24,843 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-04 04:59:24,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-04 04:59:24,854 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:35697, startcode=1696395563431 2023-10-04 04:59:24,854 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:41937, startcode=1696395563528 2023-10-04 04:59:24,854 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38813,1696395562368 with isa=jenkins-hbase20.apache.org/148.251.75.209:46127, startcode=1696395563481 2023-10-04 04:59:24,860 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-04 04:59:24,868 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-04 04:59:24,868 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,869 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38813] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,869 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:24,869 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:24,869 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34757 2023-10-04 04:59:24,869 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34757 2023-10-04 04:59:24,870 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 04:59:24,870 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 04:59:24,870 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:24,870 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34757 2023-10-04 04:59:24,870 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 04:59:24,875 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 04:59:24,876 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ZKUtil(162): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,877 WARN [RS:2;jenkins-hbase20:41937] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 04:59:24,877 INFO [RS:2;jenkins-hbase20:41937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 04:59:24,877 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,877 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ZKUtil(162): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,877 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46127,1696395563481] 2023-10-04 04:59:24,877 WARN [RS:0;jenkins-hbase20:35697] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 04:59:24,877 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41937,1696395563528] 2023-10-04 04:59:24,878 INFO [RS:0;jenkins-hbase20:35697] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 04:59:24,878 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35697,1696395563431] 2023-10-04 04:59:24,878 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,878 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ZKUtil(162): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,878 WARN [RS:1;jenkins-hbase20:46127] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 04:59:24,879 INFO [RS:1;jenkins-hbase20:46127] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 04:59:24,879 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,891 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ZKUtil(162): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,891 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ZKUtil(162): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,891 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ZKUtil(162): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:24,892 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ZKUtil(162): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,892 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ZKUtil(162): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,892 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ZKUtil(162): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:24,892 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ZKUtil(162): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,892 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ZKUtil(162): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,892 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ZKUtil(162): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:24,902 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 04:59:24,902 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 04:59:24,902 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 04:59:24,911 INFO [RS:1;jenkins-hbase20:46127] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 04:59:24,911 INFO [RS:0;jenkins-hbase20:35697] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 04:59:24,911 INFO [RS:2;jenkins-hbase20:41937] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 04:59:24,931 INFO [RS:2;jenkins-hbase20:41937] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 04:59:24,932 INFO [RS:1;jenkins-hbase20:46127] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 04:59:24,932 INFO [RS:0;jenkins-hbase20:35697] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 04:59:24,936 INFO [RS:1;jenkins-hbase20:46127] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 04:59:24,936 INFO [RS:2;jenkins-hbase20:41937] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 04:59:24,936 INFO [RS:0;jenkins-hbase20:35697] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 04:59:24,936 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,936 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,937 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,938 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 04:59:24,938 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 04:59:24,938 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 04:59:24,951 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,951 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,951 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,952 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,952 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 04:59:24,953 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 04:59:24,953 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-04 04:59:24,954 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,953 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:1;jenkins-hbase20:46127] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:0;jenkins-hbase20:35697] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,954 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,955 DEBUG [RS:2;jenkins-hbase20:41937] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-04 04:59:24,957 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,957 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,976 INFO [RS:2;jenkins-hbase20:41937] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 04:59:24,976 INFO [RS:1;jenkins-hbase20:46127] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 04:59:24,977 INFO [RS:0;jenkins-hbase20:35697] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 04:59:24,980 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41937,1696395563528-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,980 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35697,1696395563431-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:24,980 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46127,1696395563481-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,002 INFO [RS:2;jenkins-hbase20:41937] regionserver.Replication(203): jenkins-hbase20.apache.org,41937,1696395563528 started 2023-10-04 04:59:25,002 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,41937,1696395563528, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41937, sessionid=0x100fb50db750003 2023-10-04 04:59:25,003 INFO [RS:1;jenkins-hbase20:46127] regionserver.Replication(203): jenkins-hbase20.apache.org,46127,1696395563481 started 2023-10-04 04:59:25,003 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 04:59:25,003 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,46127,1696395563481, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46127, sessionid=0x100fb50db750002 2023-10-04 04:59:25,003 DEBUG [RS:2;jenkins-hbase20:41937] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:25,003 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 04:59:25,003 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41937,1696395563528' 2023-10-04 04:59:25,003 DEBUG [RS:1;jenkins-hbase20:46127] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:25,004 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 04:59:25,004 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46127,1696395563481' 2023-10-04 04:59:25,004 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 04:59:25,005 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 04:59:25,005 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 04:59:25,005 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 04:59:25,005 INFO [RS:0;jenkins-hbase20:35697] regionserver.Replication(203): jenkins-hbase20.apache.org,35697,1696395563431 started 2023-10-04 04:59:25,005 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 04:59:25,006 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,35697,1696395563431, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35697, sessionid=0x100fb50db750001 2023-10-04 04:59:25,006 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 04:59:25,006 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 04:59:25,006 DEBUG [RS:1;jenkins-hbase20:46127] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:25,006 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 04:59:25,007 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46127,1696395563481' 2023-10-04 04:59:25,006 DEBUG [RS:2;jenkins-hbase20:41937] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:25,007 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:25,007 DEBUG [RS:0;jenkins-hbase20:35697] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:25,007 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35697,1696395563431' 2023-10-04 04:59:25,007 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 04:59:25,007 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41937,1696395563528' 2023-10-04 04:59:25,007 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:25,008 DEBUG [RS:1;jenkins-hbase20:46127] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:25,008 DEBUG [RS:2;jenkins-hbase20:41937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:25,008 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 04:59:25,008 DEBUG [RS:1;jenkins-hbase20:46127] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 04:59:25,008 INFO [RS:1;jenkins-hbase20:46127] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 04:59:25,008 INFO [RS:1;jenkins-hbase20:46127] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 04:59:25,008 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 04:59:25,008 DEBUG [RS:2;jenkins-hbase20:41937] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 04:59:25,008 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 04:59:25,009 INFO [RS:2;jenkins-hbase20:41937] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 04:59:25,009 DEBUG [RS:0;jenkins-hbase20:35697] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:25,009 INFO [RS:2;jenkins-hbase20:41937] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 04:59:25,010 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35697,1696395563431' 2023-10-04 04:59:25,010 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:25,010 DEBUG [RS:0;jenkins-hbase20:35697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:25,011 DEBUG [RS:0;jenkins-hbase20:35697] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 04:59:25,011 INFO [RS:0;jenkins-hbase20:35697] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 04:59:25,011 INFO [RS:0;jenkins-hbase20:35697] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 04:59:25,019 DEBUG [jenkins-hbase20:38813] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-04 04:59:25,023 DEBUG [jenkins-hbase20:38813] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 04:59:25,028 DEBUG [jenkins-hbase20:38813] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 04:59:25,028 DEBUG [jenkins-hbase20:38813] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 04:59:25,028 DEBUG [jenkins-hbase20:38813] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 04:59:25,028 DEBUG [jenkins-hbase20:38813] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 04:59:25,031 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41937,1696395563528, state=OPENING 2023-10-04 04:59:25,037 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-04 04:59:25,038 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:25,039 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 04:59:25,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41937,1696395563528}] 2023-10-04 04:59:25,118 INFO [RS:0;jenkins-hbase20:35697] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35697%2C1696395563431, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,35697,1696395563431, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs, maxLogs=32 2023-10-04 04:59:25,118 INFO [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41937%2C1696395563528, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,41937,1696395563528, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs, maxLogs=32 2023-10-04 04:59:25,118 INFO [RS:1;jenkins-hbase20:46127] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46127%2C1696395563481, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,46127,1696395563481, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs, maxLogs=32 2023-10-04 04:59:25,143 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK] 2023-10-04 04:59:25,143 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK] 2023-10-04 04:59:25,145 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK] 2023-10-04 04:59:25,151 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK] 2023-10-04 04:59:25,152 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK] 2023-10-04 04:59:25,155 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK] 2023-10-04 04:59:25,155 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK] 2023-10-04 04:59:25,155 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK] 2023-10-04 04:59:25,156 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK] 2023-10-04 04:59:25,167 INFO [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,41937,1696395563528/jenkins-hbase20.apache.org%2C41937%2C1696395563528.1696395565123 2023-10-04 04:59:25,168 INFO [RS:1;jenkins-hbase20:46127] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,46127,1696395563481/jenkins-hbase20.apache.org%2C46127%2C1696395563481.1696395565123 2023-10-04 04:59:25,168 INFO [RS:0;jenkins-hbase20:35697] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,35697,1696395563431/jenkins-hbase20.apache.org%2C35697%2C1696395563431.1696395565123 2023-10-04 04:59:25,170 DEBUG [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK], DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK], DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK]] 2023-10-04 04:59:25,170 DEBUG [RS:1;jenkins-hbase20:46127] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK], DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK], DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK]] 2023-10-04 04:59:25,174 DEBUG [RS:0;jenkins-hbase20:35697] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK], DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK], DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK]] 2023-10-04 04:59:25,225 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:25,227 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 04:59:25,229 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 04:59:25,242 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-04 04:59:25,243 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 04:59:25,247 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41937%2C1696395563528.meta, suffix=.meta, logDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,41937,1696395563528, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs, maxLogs=32 2023-10-04 04:59:25,265 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK] 2023-10-04 04:59:25,266 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK] 2023-10-04 04:59:25,268 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK] 2023-10-04 04:59:25,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/WALs/jenkins-hbase20.apache.org,41937,1696395563528/jenkins-hbase20.apache.org%2C41937%2C1696395563528.meta.1696395565249.meta 2023-10-04 04:59:25,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43123,DS-d4be723d-1a26-4039-b127-0041637ce3a7,DISK], DatanodeInfoWithStorage[127.0.0.1:44043,DS-9bddc765-8250-42ab-be93-e1014a2dc11e,DISK], DatanodeInfoWithStorage[127.0.0.1:38567,DS-cb040711-3714-4db4-9905-05c8c1cbdff3,DISK]] 2023-10-04 04:59:25,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-04 04:59:25,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-04 04:59:25,278 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:25,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-04 04:59:25,281 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-04 04:59:25,282 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-04 04:59:25,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-04 04:59:25,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:25,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-04 04:59:25,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-04 04:59:25,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 04:59:25,301 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/info 2023-10-04 04:59:25,301 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/info 2023-10-04 04:59:25,301 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 04:59:25,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:25,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 04:59:25,304 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/rep_barrier 2023-10-04 04:59:25,304 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/rep_barrier 2023-10-04 04:59:25,305 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 04:59:25,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:25,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 04:59:25,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/table 2023-10-04 04:59:25,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/table 2023-10-04 04:59:25,309 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 04:59:25,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:25,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740 2023-10-04 04:59:25,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740 2023-10-04 04:59:25,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 04:59:25,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 04:59:25,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64279155, jitterRate=-0.04216594994068146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 04:59:25,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 04:59:25,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696395565218 2023-10-04 04:59:25,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-04 04:59:25,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-04 04:59:25,357 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41937,1696395563528, state=OPEN 2023-10-04 04:59:25,360 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-04 04:59:25,360 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 04:59:25,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-04 04:59:25,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41937,1696395563528 in 316 msec 2023-10-04 04:59:25,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-04 04:59:25,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 517 msec 2023-10-04 04:59:25,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 752 msec 2023-10-04 04:59:25,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696395565377, completionTime=-1 2023-10-04 04:59:25,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-04 04:59:25,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-04 04:59:25,440 DEBUG [hconnection-0x5165e80f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:25,443 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:25,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-04 04:59:25,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696395625462 2023-10-04 04:59:25,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696395685462 2023-10-04 04:59:25,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 84 msec 2023-10-04 04:59:25,490 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38813,1696395562368-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38813,1696395562368-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38813,1696395562368-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:38813, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-04 04:59:25,506 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-04 04:59:25,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-04 04:59:25,514 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 04:59:25,522 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-04 04:59:25,525 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 04:59:25,528 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 04:59:25,548 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/namespace/588abd40188712389a363930197f4215 2023-10-04 04:59:25,551 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/namespace/588abd40188712389a363930197f4215 empty. 2023-10-04 04:59:25,552 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/namespace/588abd40188712389a363930197f4215 2023-10-04 04:59:25,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-04 04:59:25,598 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:25,600 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 588abd40188712389a363930197f4215, NAME => 'hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 588abd40188712389a363930197f4215, disabling compactions & flushes 2023-10-04 04:59:25,627 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. after waiting 0 ms 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:25,627 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:25,627 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 588abd40188712389a363930197f4215: 2023-10-04 04:59:25,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 04:59:25,650 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696395565636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395565636"}]},"ts":"1696395565636"} 2023-10-04 04:59:25,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 04:59:25,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 04:59:25,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395565678"}]},"ts":"1696395565678"} 2023-10-04 04:59:25,687 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-04 04:59:25,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 04:59:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 04:59:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 04:59:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 04:59:25,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 04:59:25,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=588abd40188712389a363930197f4215, ASSIGN}] 2023-10-04 04:59:25,697 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=588abd40188712389a363930197f4215, ASSIGN 2023-10-04 04:59:25,699 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=588abd40188712389a363930197f4215, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 04:59:25,851 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 04:59:25,852 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=588abd40188712389a363930197f4215, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:25,852 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696395565852"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395565852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395565852"}]},"ts":"1696395565852"} 2023-10-04 04:59:25,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 588abd40188712389a363930197f4215, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 04:59:26,015 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:26,016 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 04:59:26,022 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 04:59:26,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:26,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 588abd40188712389a363930197f4215, NAME => 'hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.', STARTKEY => '', ENDKEY => ''} 2023-10-04 04:59:26,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. service=AccessControlService 2023-10-04 04:59:26,030 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:26,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 588abd40188712389a363930197f4215 2023-10-04 04:59:26,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:26,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 588abd40188712389a363930197f4215 2023-10-04 04:59:26,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 588abd40188712389a363930197f4215 2023-10-04 04:59:26,034 INFO [StoreOpener-588abd40188712389a363930197f4215-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 588abd40188712389a363930197f4215 2023-10-04 04:59:26,036 DEBUG [StoreOpener-588abd40188712389a363930197f4215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/info 2023-10-04 04:59:26,037 DEBUG [StoreOpener-588abd40188712389a363930197f4215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/info 2023-10-04 04:59:26,037 INFO [StoreOpener-588abd40188712389a363930197f4215-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 588abd40188712389a363930197f4215 columnFamilyName info 2023-10-04 04:59:26,038 INFO [StoreOpener-588abd40188712389a363930197f4215-1] regionserver.HStore(310): Store=588abd40188712389a363930197f4215/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:26,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215 2023-10-04 04:59:26,041 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215 2023-10-04 04:59:26,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 588abd40188712389a363930197f4215 2023-10-04 04:59:26,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:26,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 588abd40188712389a363930197f4215; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60856371, jitterRate=-0.09316940605640411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:26,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 588abd40188712389a363930197f4215: 2023-10-04 04:59:26,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696395565514.588abd40188712389a363930197f4215., pid=6, masterSystemTime=1696395566015 2023-10-04 04:59:26,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:26,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 04:59:26,064 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=588abd40188712389a363930197f4215, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:26,064 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696395566063"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395566063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395566063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395566063"}]},"ts":"1696395566063"} 2023-10-04 04:59:26,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-04 04:59:26,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 588abd40188712389a363930197f4215, server=jenkins-hbase20.apache.org,35697,1696395563431 in 210 msec 2023-10-04 04:59:26,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-04 04:59:26,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=588abd40188712389a363930197f4215, ASSIGN in 380 msec 2023-10-04 04:59:26,080 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 04:59:26,080 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395566080"}]},"ts":"1696395566080"} 2023-10-04 04:59:26,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-04 04:59:26,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 04:59:26,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 571 msec 2023-10-04 04:59:26,124 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-04 04:59:26,126 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-04 04:59:26,126 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:26,146 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:26,150 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:26,167 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-04 04:59:26,192 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 04:59:26,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-10-04 04:59:26,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-04 04:59:26,225 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 04:59:26,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-10-04 04:59:26,248 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-04 04:59:26,249 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-04 04:59:26,250 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.652sec 2023-10-04 04:59:26,252 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-04 04:59:26,254 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-04 04:59:26,254 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-04 04:59:26,255 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38813,1696395562368-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-04 04:59:26,256 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38813,1696395562368-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-04 04:59:26,261 DEBUG [Listener at localhost/41961] zookeeper.ReadOnlyZKClient(139): Connect 0x1558f774 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:26,267 DEBUG [Listener at localhost/41961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@650bb054, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:26,281 DEBUG [hconnection-0x3bbff57b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:26,281 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 04:59:26,284 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-04 04:59:26,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 04:59:26,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 04:59:26,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-04 04:59:26,292 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/acl/0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,293 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/acl/0f288faf3884241968075d680c7c7cd9 empty. 2023-10-04 04:59:26,297 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/acl/0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,297 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-04 04:59:26,299 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:26,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/test.cache.data in system properties and HBase conf 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop.log.dir in system properties and HBase conf 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 04:59:26,302 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/nfs.dump.dir in system properties and HBase conf 2023-10-04 04:59:26,303 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir in system properties and HBase conf 2023-10-04 04:59:26,304 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 04:59:26,304 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 04:59:26,304 INFO [Listener at localhost/41961] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-04 04:59:26,332 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:26,334 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f288faf3884241968075d680c7c7cd9, NAME => 'hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:26,367 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:26,367 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0f288faf3884241968075d680c7c7cd9, disabling compactions & flushes 2023-10-04 04:59:26,367 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,367 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,367 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. after waiting 0 ms 2023-10-04 04:59:26,367 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,368 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,368 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0f288faf3884241968075d680c7c7cd9: 2023-10-04 04:59:26,380 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 04:59:26,382 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696395566381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395566381"}]},"ts":"1696395566381"} 2023-10-04 04:59:26,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 04:59:26,391 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 04:59:26,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395566392"}]},"ts":"1696395566392"} 2023-10-04 04:59:26,395 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-04 04:59:26,398 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 04:59:26,399 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 04:59:26,399 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 04:59:26,399 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 04:59:26,399 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 04:59:26,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0f288faf3884241968075d680c7c7cd9, ASSIGN}] 2023-10-04 04:59:26,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 04:59:26,409 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0f288faf3884241968075d680c7c7cd9, ASSIGN 2023-10-04 04:59:26,411 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0f288faf3884241968075d680c7c7cd9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 04:59:26,561 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 04:59:26,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0f288faf3884241968075d680c7c7cd9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:26,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696395566562"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395566562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395566562"}]},"ts":"1696395566562"} 2023-10-04 04:59:26,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0f288faf3884241968075d680c7c7cd9, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 04:59:26,609 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 04:59:26,721 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:26,721 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 04:59:26,725 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 04:59:26,731 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f288faf3884241968075d680c7c7cd9, NAME => 'hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.', STARTKEY => '', ENDKEY => ''} 2023-10-04 04:59:26,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. service=AccessControlService 2023-10-04 04:59:26,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:26,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:26,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,735 INFO [StoreOpener-0f288faf3884241968075d680c7c7cd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,738 DEBUG [StoreOpener-0f288faf3884241968075d680c7c7cd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/l 2023-10-04 04:59:26,738 DEBUG [StoreOpener-0f288faf3884241968075d680c7c7cd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/l 2023-10-04 04:59:26,739 INFO [StoreOpener-0f288faf3884241968075d680c7c7cd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f288faf3884241968075d680c7c7cd9 columnFamilyName l 2023-10-04 04:59:26,740 INFO [StoreOpener-0f288faf3884241968075d680c7c7cd9-1] regionserver.HStore(310): Store=0f288faf3884241968075d680c7c7cd9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:26,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0f288faf3884241968075d680c7c7cd9 2023-10-04 04:59:26,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:26,759 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0f288faf3884241968075d680c7c7cd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66653808, jitterRate=-0.006780862808227539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:26,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0f288faf3884241968075d680c7c7cd9: 2023-10-04 04:59:26,761 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9., pid=11, masterSystemTime=1696395566721 2023-10-04 04:59:26,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,768 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 04:59:26,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0f288faf3884241968075d680c7c7cd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:26,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696395566769"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395566769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395566769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395566769"}]},"ts":"1696395566769"} 2023-10-04 04:59:26,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-04 04:59:26,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0f288faf3884241968075d680c7c7cd9, server=jenkins-hbase20.apache.org,46127,1696395563481 in 207 msec 2023-10-04 04:59:26,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-04 04:59:26,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0f288faf3884241968075d680c7c7cd9, ASSIGN in 377 msec 2023-10-04 04:59:26,783 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 04:59:26,784 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395566783"}]},"ts":"1696395566783"} 2023-10-04 04:59:26,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-04 04:59:26,790 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 04:59:26,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 508 msec 2023-10-04 04:59:26,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 04:59:26,909 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-04 04:59:26,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-04 04:59:27,371 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:27,612 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:27,617 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_41061_jobhistory____.pjirn9/webapp 2023-10-04 04:59:27,786 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-04 04:59:27,787 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-04 04:59:27,787 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 04:59:27,789 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 04:59:27,854 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:28,103 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:28,405 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-04 04:59:28,437 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:41061 2023-10-04 04:59:28,862 WARN [Listener at jenkins-hbase20.apache.org/36733] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:29,067 WARN [Listener at jenkins-hbase20.apache.org/36733] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 04:59:29,068 INFO [Listener at jenkins-hbase20.apache.org/36733] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:29,073 INFO [Listener at jenkins-hbase20.apache.org/36733] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_45983_cluster____.c4msrn/webapp 2023-10-04 04:59:29,127 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 04:59:29,128 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-04 04:59:29,128 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 04:59:29,128 INFO [Listener at jenkins-hbase20.apache.org/36733] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 04:59:29,135 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:29,288 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:29,381 INFO [Listener at jenkins-hbase20.apache.org/36733] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:29,389 INFO [Listener at jenkins-hbase20.apache.org/36733] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:45983 2023-10-04 04:59:29,818 WARN [Listener at jenkins-hbase20.apache.org/40743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:29,842 WARN [Listener at jenkins-hbase20.apache.org/40743] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 04:59:29,843 INFO [Listener at jenkins-hbase20.apache.org/40743] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:29,850 INFO [Listener at jenkins-hbase20.apache.org/40743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34571_node____kuehsw/webapp 2023-10-04 04:59:29,989 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 04:59:29,989 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 04:59:29,989 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 04:59:29,989 INFO [Listener at jenkins-hbase20.apache.org/40743] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 04:59:29,998 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,019 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,116 INFO [Listener at jenkins-hbase20.apache.org/40743] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,128 INFO [Listener at jenkins-hbase20.apache.org/40743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34571 2023-10-04 04:59:30,290 WARN [Listener at jenkins-hbase20.apache.org/35111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 04:59:30,299 WARN [Listener at jenkins-hbase20.apache.org/35111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 04:59:30,300 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 04:59:30,307 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_45091_node____i5n0mx/webapp 2023-10-04 04:59:30,396 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 04:59:30,397 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 04:59:30,397 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 04:59:30,397 INFO [Listener at jenkins-hbase20.apache.org/35111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 04:59:30,408 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,422 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,491 INFO [Listener at jenkins-hbase20.apache.org/35111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 04:59:30,508 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:45091 2023-10-04 04:59:30,538 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-04 04:59:30,540 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 04:59:30,592 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=163, AvailableMemoryMB=2103 2023-10-04 04:59:30,593 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-10-04 04:59:30,606 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-04 04:59:30,611 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-04 04:59:30,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 04:59:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:30,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 04:59:30,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-04 04:59:30,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 04:59:30,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 04:59:30,634 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:30,634 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:30,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 empty. 2023-10-04 04:59:30,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 empty. 2023-10-04 04:59:30,637 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:30,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:30,637 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 04:59:30,673 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:30,675 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 112a40d2157a9161b06d0da64df405b3, NAME => 'testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:30,675 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 12e7853804c24bce53190d55e8fb24a8, NAME => 'testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:30,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:30,727 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 112a40d2157a9161b06d0da64df405b3, disabling compactions & flushes 2023-10-04 04:59:30,728 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:30,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:30,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:30,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. after waiting 0 ms 2023-10-04 04:59:30,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 12e7853804c24bce53190d55e8fb24a8, disabling compactions & flushes 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:30,729 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:30,729 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 112a40d2157a9161b06d0da64df405b3: 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. after waiting 0 ms 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:30,729 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:30,729 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 12e7853804c24bce53190d55e8fb24a8: 2023-10-04 04:59:30,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 04:59:30,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 04:59:30,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395570735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395570735"}]},"ts":"1696395570735"} 2023-10-04 04:59:30,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395570735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395570735"}]},"ts":"1696395570735"} 2023-10-04 04:59:30,779 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 04:59:30,781 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 04:59:30,781 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395570781"}]},"ts":"1696395570781"} 2023-10-04 04:59:30,784 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-04 04:59:30,787 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 04:59:30,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 04:59:30,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 04:59:30,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 04:59:30,790 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 04:59:30,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, ASSIGN}] 2023-10-04 04:59:30,794 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, ASSIGN 2023-10-04 04:59:30,794 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, ASSIGN 2023-10-04 04:59:30,795 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 04:59:30,795 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 04:59:30,851 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 04:59:30,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 04:59:30,945 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 04:59:30,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=112a40d2157a9161b06d0da64df405b3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:30,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=12e7853804c24bce53190d55e8fb24a8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:30,948 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395570947"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395570947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395570947"}]},"ts":"1696395570947"} 2023-10-04 04:59:30,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395570947"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395570947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395570947"}]},"ts":"1696395570947"} 2023-10-04 04:59:30,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 112a40d2157a9161b06d0da64df405b3, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 04:59:30,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 12e7853804c24bce53190d55e8fb24a8, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 04:59:31,020 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-04 04:59:31,021 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-04 04:59:31,022 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-04 04:59:31,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:31,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 112a40d2157a9161b06d0da64df405b3, NAME => 'testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 04:59:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12e7853804c24bce53190d55e8fb24a8, NAME => 'testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 04:59:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. service=AccessControlService 2023-10-04 04:59:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. service=AccessControlService 2023-10-04 04:59:31,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:31,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,117 INFO [StoreOpener-12e7853804c24bce53190d55e8fb24a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,117 INFO [StoreOpener-112a40d2157a9161b06d0da64df405b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,123 DEBUG [StoreOpener-112a40d2157a9161b06d0da64df405b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf 2023-10-04 04:59:31,123 DEBUG [StoreOpener-112a40d2157a9161b06d0da64df405b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf 2023-10-04 04:59:31,123 DEBUG [StoreOpener-12e7853804c24bce53190d55e8fb24a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf 2023-10-04 04:59:31,123 DEBUG [StoreOpener-12e7853804c24bce53190d55e8fb24a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf 2023-10-04 04:59:31,127 INFO [StoreOpener-12e7853804c24bce53190d55e8fb24a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12e7853804c24bce53190d55e8fb24a8 columnFamilyName cf 2023-10-04 04:59:31,127 INFO [StoreOpener-112a40d2157a9161b06d0da64df405b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 112a40d2157a9161b06d0da64df405b3 columnFamilyName cf 2023-10-04 04:59:31,130 INFO [StoreOpener-12e7853804c24bce53190d55e8fb24a8-1] regionserver.HStore(310): Store=12e7853804c24bce53190d55e8fb24a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:31,130 INFO [StoreOpener-112a40d2157a9161b06d0da64df405b3-1] regionserver.HStore(310): Store=112a40d2157a9161b06d0da64df405b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:31,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:31,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:31,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:31,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:31,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 12e7853804c24bce53190d55e8fb24a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64154365, jitterRate=-0.04402546584606171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:31,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 12e7853804c24bce53190d55e8fb24a8: 2023-10-04 04:59:31,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 112a40d2157a9161b06d0da64df405b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64800019, jitterRate=-0.03440447151660919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:31,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 112a40d2157a9161b06d0da64df405b3: 2023-10-04 04:59:31,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8., pid=16, masterSystemTime=1696395571108 2023-10-04 04:59:31,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3., pid=15, masterSystemTime=1696395571105 2023-10-04 04:59:31,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=12e7853804c24bce53190d55e8fb24a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:31,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395571161"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395571161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395571161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395571161"}]},"ts":"1696395571161"} 2023-10-04 04:59:31,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:31,163 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=112a40d2157a9161b06d0da64df405b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:31,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:31,164 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395571163"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395571163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395571163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395571163"}]},"ts":"1696395571163"} 2023-10-04 04:59:31,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-04 04:59:31,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 12e7853804c24bce53190d55e8fb24a8, server=jenkins-hbase20.apache.org,35697,1696395563431 in 212 msec 2023-10-04 04:59:31,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-04 04:59:31,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, ASSIGN in 379 msec 2023-10-04 04:59:31,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 112a40d2157a9161b06d0da64df405b3, server=jenkins-hbase20.apache.org,46127,1696395563481 in 217 msec 2023-10-04 04:59:31,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-04 04:59:31,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, ASSIGN in 384 msec 2023-10-04 04:59:31,180 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 04:59:31,180 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395571180"}]},"ts":"1696395571180"} 2023-10-04 04:59:31,183 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-04 04:59:31,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 04:59:31,189 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-04 04:59:31,195 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,198 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,202 DEBUG [hconnection-0x404b2487-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,206 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,213 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 04:59:31,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:31,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:31,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:31,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:31,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 04:59:31,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 04:59:31,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:31,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:31,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:31,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:31,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 625 msec 2023-10-04 04:59:31,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 04:59:31,743 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-04 04:59:31,747 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 04:59:31,748 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:31,750 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 04:59:31,773 DEBUG [hconnection-0x3bbff57b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,776 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,779 DEBUG [hconnection-0x3bbff57b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,782 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:31,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395571795 (current time:1696395571795). 2023-10-04 04:59:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 04:59:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x25ecb764 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:31,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21cd7937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:31,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,806 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25ecb764 to 127.0.0.1:60951 2023-10-04 04:59:31,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:31,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x67fe19aa to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:31,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30642fd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:31,823 DEBUG [hconnection-0x5be16da4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,825 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:31,831 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:31,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67fe19aa to 127.0.0.1:60951 2023-10-04 04:59:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 04:59:31,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 04:59:31,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:31,873 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 04:59:31,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:31,897 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:31,898 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696396171898 2023-10-04 04:59:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:31,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 04:59:31,902 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:31,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:31,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-10-04 04:59:31,906 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:31,907 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 04:59:31,907 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 04:59:31,907 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696396171907 2023-10-04 04:59:31,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,940 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-04 04:59:31,940 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:31,942 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 04:59:31,942 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 04:59:31,943 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,943 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,945 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:31,945 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,945 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:31,945 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:31,946 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:31,946 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,946 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,946 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:31,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:31,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:31,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,952 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:31,952 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:31,953 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:31,954 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:31,961 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,961 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:31,961 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,961 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,961 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,961 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,962 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:31,962 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,962 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:31,962 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,962 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@542de70f[Count = 1] remaining members to acquire global barrier 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:31,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 04:59:31,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@542de70f[Count = 0] remaining members to acquire global barrier 2023-10-04 04:59:31,966 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 04:59:31,966 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:31,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,969 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:31,969 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:31,969 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 04:59:31,969 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:31,969 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:31,969 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 04:59:31,970 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:31,970 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:31,970 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:31,970 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:31,970 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. started... 2023-10-04 04:59:31,972 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:31,974 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:31,974 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. started... 2023-10-04 04:59:31,974 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:31,975 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:31,976 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:31,976 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:31,974 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 112a40d2157a9161b06d0da64df405b3: 2023-10-04 04:59:31,975 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12e7853804c24bce53190d55e8fb24a8: 2023-10-04 04:59:31,978 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,978 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:31,984 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:31,984 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:31,987 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 04:59:31,987 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 04:59:32,008 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:32,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:32,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:32,015 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 04:59:32,215 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:32,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:32,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:32,217 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 04:59:32,415 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. completed. 2023-10-04 04:59:32,415 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. completed. 2023-10-04 04:59:32,415 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:32,415 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:32,415 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:32,415 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:32,415 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 04:59:32,416 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 04:59:32,417 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:32,417 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,417 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:32,417 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:32,419 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,419 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:32,419 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:32,419 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 04:59:32,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 04:59:32,429 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-04 04:59:32,429 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 04:59:32,429 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 04:59:32,429 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,429 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,434 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,434 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,434 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:32,436 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,436 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,437 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,447 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,448 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:32,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:32,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 04:59:32,449 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,450 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:32,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 04:59:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:32,450 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:32,450 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,450 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 04:59:32,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,502 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 04:59:32,503 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-04 04:59:32,503 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 04:59:32,503 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-04 04:59:32,503 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 04:59:32,503 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-04 04:59:32,503 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 04:59:32,503 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-04 04:59:32,504 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 04:59:32,504 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-04 04:59:32,518 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:32,519 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-04 04:59:32,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 04:59:32,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,523 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:32,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696395571899Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696395572469 (+570 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696395572470 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696395572470Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696395572484 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696395572508 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696395572521 (+13 ms) 2023-10-04 04:59:32,526 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:32,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 626 msec 2023-10-04 04:59:33,019 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:33,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:33,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 04:59:33,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 04:59:33,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 04:59:33,048 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 04:59:33,048 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:33,048 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 04:59:33,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395573067 (current time:1696395573067). 2023-10-04 04:59:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 04:59:33,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x4b353826 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d0245d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:33,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:33,076 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:33,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b353826 to 127.0.0.1:60951 2023-10-04 04:59:33,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:33,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x1c886ccb to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:33,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e1e8374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:33,085 DEBUG [hconnection-0x511d3de3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:33,088 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:33,096 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:33,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c886ccb to 127.0.0.1:60951 2023-10-04 04:59:33,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:33,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 04:59:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 04:59:33,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:33,102 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 04:59:33,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:33,106 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:33,107 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696396173107 2023-10-04 04:59:33,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 04:59:33,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 04:59:33,109 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 04:59:33,109 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 04:59:33,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:33,111 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 04:59:33,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-10-04 04:59:33,114 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:33,115 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696396173115 2023-10-04 04:59:33,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-04 04:59:33,138 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-04 04:59:33,138 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:33,139 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 04:59:33,139 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 04:59:33,140 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,140 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,141 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,141 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,141 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,142 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 04:59:33,143 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:33,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 04:59:33,143 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:33,143 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:33,144 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:33,144 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:33,143 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 04:59:33,145 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:33,145 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:33,144 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:33,145 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:33,145 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:33,145 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:33,146 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 04:59:33,146 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 04:59:33,146 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 04:59:33,154 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,154 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:33,158 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:33,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,158 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:33,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4acc9279[Count = 1] remaining members to acquire global barrier 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:33,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:33,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:33,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:33,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 04:59:33,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4acc9279[Count = 0] remaining members to acquire global barrier 2023-10-04 04:59:33,163 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 04:59:33,163 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:33,172 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 04:59:33,173 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. started... 2023-10-04 04:59:33,173 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:33,172 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:33,173 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:33,172 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,173 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 04:59:33,173 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. started... 2023-10-04 04:59:33,173 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 112a40d2157a9161b06d0da64df405b3 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-04 04:59:33,173 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 12e7853804c24bce53190d55e8fb24a8 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-04 04:59:33,175 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:33,175 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:33,175 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:33,209 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:33,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:33,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:33,211 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 04:59:33,298 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d 2023-10-04 04:59:33,298 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4 2023-10-04 04:59:33,336 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/.tmp/cf/92959c3edf21421bb04978df585b0910 2023-10-04 04:59:33,337 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/.tmp/cf/9f452d47afaa4019af869a63b63378aa 2023-10-04 04:59:33,348 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/.tmp/cf/92959c3edf21421bb04978df585b0910 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910 2023-10-04 04:59:33,349 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/.tmp/cf/9f452d47afaa4019af869a63b63378aa as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa 2023-10-04 04:59:33,357 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa, entries=6, sequenceid=6, filesize=5.9 K 2023-10-04 04:59:33,357 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910, entries=44, sequenceid=6, filesize=12.3 K 2023-10-04 04:59:33,362 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 112a40d2157a9161b06d0da64df405b3 in 189ms, sequenceid=6, compaction requested=false 2023-10-04 04:59:33,362 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 12e7853804c24bce53190d55e8fb24a8 in 189ms, sequenceid=6, compaction requested=false 2023-10-04 04:59:33,362 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 04:59:33,362 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 04:59:33,365 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 112a40d2157a9161b06d0da64df405b3: 2023-10-04 04:59:33,365 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12e7853804c24bce53190d55e8fb24a8: 2023-10-04 04:59:33,365 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 04:59:33,365 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 04:59:33,365 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:33,366 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:33,366 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910] hfiles 2023-10-04 04:59:33,366 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa] hfiles 2023-10-04 04:59:33,366 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 04:59:33,366 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa for snapshot=snaptb0-testExportWithTargetName 2023-10-04 04:59:33,389 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. completed. 2023-10-04 04:59:33,389 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:33,389 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:33,389 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:33,389 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,389 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:33,389 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 04:59:33,390 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. completed. 2023-10-04 04:59:33,390 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 04:59:33,390 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:33,390 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:33,391 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 04:59:33,392 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:33,393 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:33,393 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 04:59:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 04:59:33,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 04:59:33,406 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-04 04:59:33,406 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 04:59:33,406 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 04:59:33,406 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-04 04:59:33,406 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 04:59:33,411 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,412 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,413 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:33,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,413 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,414 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 04:59:33,414 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,414 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,416 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,417 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,417 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 04:59:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-04 04:59:33,427 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:33,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:33,427 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:33,428 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 04:59:33,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 04:59:33,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,429 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4] mob files 2023-10-04 04:59:33,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d 2023-10-04 04:59:33,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4 2023-10-04 04:59:33,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-04 04:59:33,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 04:59:33,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,482 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 04:59:33,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696395573107Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696395573447 (+340 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696395573447Loading Region manifests for snaptb0-testExportWithTargetName at 1696395573448 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1696395573452 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696395573469 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696395573481 (+12 ms) 2023-10-04 04:59:33,483 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 04:59:33,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 376 msec 2023-10-04 04:59:33,714 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:33,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 04:59:33,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 04:59:33,718 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718 2023-10-04 04:59:33,718 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34757, tgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718, rawTgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:33,751 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:33,751 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1712162648_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 04:59:33,751 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-04 04:59:33,770 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 04:59:34,244 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,244 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,245 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,245 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,245 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,246 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,246 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,308 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-7874455791975063679.jar 2023-10-04 04:59:34,309 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,309 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,309 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,310 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,310 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,310 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:34,311 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 04:59:34,311 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 04:59:34,312 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 04:59:34,312 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 04:59:34,313 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 04:59:34,313 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 04:59:34,314 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 04:59:34,314 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 04:59:34,315 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 04:59:34,315 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 04:59:34,318 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:34,318 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:34,318 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:34,319 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:34,319 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:34,319 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:34,320 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:35,088 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 04:59:35,094 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-04 04:59:35,102 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 04:59:35,469 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 04:59:35,470 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 04:59:35,638 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0001_000001 (auth:SIMPLE) 2023-10-04 04:59:36,621 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 04:59:39,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0001_000001 (auth:SIMPLE) 2023-10-04 04:59:41,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0001_000001 (auth:SIMPLE) 2023-10-04 04:59:43,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0001_000001 (auth:SIMPLE) 2023-10-04 04:59:45,872 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 04:59:45,876 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 04:59:45,887 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-04 04:59:45,888 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 04:59:45,888 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 04:59:45,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 04:59:45,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-04 04:59:45,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-04 04:59:45,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/testExportWithTargetName 2023-10-04 04:59:45,890 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-04 04:59:45,890 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395573718/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-04 04:59:45,902 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-04 04:59:45,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-10-04 04:59:45,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:45,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395585920"}]},"ts":"1696395585920"} 2023-10-04 04:59:45,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 04:59:45,923 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-04 04:59:45,960 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-04 04:59:45,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, UNASSIGN}] 2023-10-04 04:59:45,964 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, UNASSIGN 2023-10-04 04:59:45,964 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, UNASSIGN 2023-10-04 04:59:45,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=112a40d2157a9161b06d0da64df405b3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:45,965 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=12e7853804c24bce53190d55e8fb24a8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:45,965 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395585965"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395585965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395585965"}]},"ts":"1696395585965"} 2023-10-04 04:59:45,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395585965"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395585965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395585965"}]},"ts":"1696395585965"} 2023-10-04 04:59:45,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 112a40d2157a9161b06d0da64df405b3, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 04:59:45,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 12e7853804c24bce53190d55e8fb24a8, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 04:59:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 04:59:46,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:46,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 112a40d2157a9161b06d0da64df405b3, disabling compactions & flushes 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 12e7853804c24bce53190d55e8fb24a8, disabling compactions & flushes 2023-10-04 04:59:46,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:46,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. after waiting 0 ms 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. after waiting 0 ms 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:46,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:46,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 04:59:46,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 04:59:46,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 04:59:46,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 04:59:46,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8. 2023-10-04 04:59:46,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3. 2023-10-04 04:59:46,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 12e7853804c24bce53190d55e8fb24a8: 2023-10-04 04:59:46,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 112a40d2157a9161b06d0da64df405b3: 2023-10-04 04:59:46,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:46,150 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=112a40d2157a9161b06d0da64df405b3, regionState=CLOSED 2023-10-04 04:59:46,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:46,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395586150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395586150"}]},"ts":"1696395586150"} 2023-10-04 04:59:46,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=12e7853804c24bce53190d55e8fb24a8, regionState=CLOSED 2023-10-04 04:59:46,151 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696395586150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395586150"}]},"ts":"1696395586150"} 2023-10-04 04:59:46,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-04 04:59:46,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 112a40d2157a9161b06d0da64df405b3, server=jenkins-hbase20.apache.org,46127,1696395563481 in 185 msec 2023-10-04 04:59:46,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-04 04:59:46,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 12e7853804c24bce53190d55e8fb24a8, server=jenkins-hbase20.apache.org,35697,1696395563431 in 184 msec 2023-10-04 04:59:46,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=112a40d2157a9161b06d0da64df405b3, UNASSIGN in 193 msec 2023-10-04 04:59:46,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-04 04:59:46,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=12e7853804c24bce53190d55e8fb24a8, UNASSIGN in 192 msec 2023-10-04 04:59:46,157 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395586157"}]},"ts":"1696395586157"} 2023-10-04 04:59:46,158 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-04 04:59:46,161 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-04 04:59:46,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 253 msec 2023-10-04 04:59:46,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 04:59:46,224 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-04 04:59:46,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-10-04 04:59:46,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,239 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-04 04:59:46,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,244 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-04 04:59:46,245 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 04:59:46,245 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 04:59:46,245 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 04:59:46,245 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 04:59:46,246 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,246 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 04:59:46,247 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 04:59:46,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 04:59:46,247 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,247 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 04:59:46,247 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 04:59:46,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 04:59:46,247 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 04:59:46,247 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 04:59:46,248 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:46,248 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:46,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 04:59:46,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/recovered.edits] 2023-10-04 04:59:46,251 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/recovered.edits] 2023-10-04 04:59:46,257 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/cf/92959c3edf21421bb04978df585b0910 2023-10-04 04:59:46,257 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/cf/9f452d47afaa4019af869a63b63378aa 2023-10-04 04:59:46,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8/recovered.edits/9.seqid 2023-10-04 04:59:46,261 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3/recovered.edits/9.seqid 2023-10-04 04:59:46,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/12e7853804c24bce53190d55e8fb24a8 2023-10-04 04:59:46,261 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportWithTargetName/112a40d2157a9161b06d0da64df405b3 2023-10-04 04:59:46,261 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 04:59:46,262 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 04:59:46,262 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-04 04:59:46,267 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100407de6f36857c41b6a8b233f3072a4f9d 2023-10-04 04:59:46,268 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004271336978616416cbfbb5fad9cbb5af4 2023-10-04 04:59:46,268 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 04:59:46,271 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,290 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-04 04:59:46,293 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-04 04:59:46,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-04 04:59:46,295 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395586295"}]},"ts":"9223372036854775807"} 2023-10-04 04:59:46,295 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395586295"}]},"ts":"9223372036854775807"} 2023-10-04 04:59:46,298 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 04:59:46,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 112a40d2157a9161b06d0da64df405b3, NAME => 'testtb-testExportWithTargetName,,1696395570617.112a40d2157a9161b06d0da64df405b3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 12e7853804c24bce53190d55e8fb24a8, NAME => 'testtb-testExportWithTargetName,1,1696395570617.12e7853804c24bce53190d55e8fb24a8.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 04:59:46,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-04 04:59:46,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395586298"}]},"ts":"9223372036854775807"} 2023-10-04 04:59:46,300 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-04 04:59:46,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 04:59:46,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 71 msec 2023-10-04 04:59:46,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 04:59:46,353 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-04 04:59:46,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-04 04:59:46,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-04 04:59:46,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-10-04 04:59:46,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-04 04:59:46,404 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:33738 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:37538 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-250907196_1 at /127.0.0.1:42622 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:35111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-250907196_1 at /127.0.0.1:37520 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:39981 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:42660 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:46133 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=943 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=1289 (was 2103) 2023-10-04 04:59:46,404 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-04 04:59:46,423 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=943, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=166, AvailableMemoryMB=1288 2023-10-04 04:59:46,423 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-04 04:59:46,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 04:59:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-04 04:59:46,430 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 04:59:46,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-04 04:59:46,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 04:59:46,434 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 04:59:46,436 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,436 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,437 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 empty. 2023-10-04 04:59:46,437 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 empty. 2023-10-04 04:59:46,437 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,438 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 04:59:46,449 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 04:59:46,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9352b604ac5a4cd0491cdf10484f77f5, NAME => 'testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:46,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 38c82e881b78afe1bb3be17ca42e6344, NAME => 'testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 04:59:46,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:46,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9352b604ac5a4cd0491cdf10484f77f5, disabling compactions & flushes 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 38c82e881b78afe1bb3be17ca42e6344, disabling compactions & flushes 2023-10-04 04:59:46,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. after waiting 0 ms 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. after waiting 0 ms 2023-10-04 04:59:46,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 38c82e881b78afe1bb3be17ca42e6344: 2023-10-04 04:59:46,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9352b604ac5a4cd0491cdf10484f77f5: 2023-10-04 04:59:46,476 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 04:59:46,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395586477"}]},"ts":"1696395586477"} 2023-10-04 04:59:46,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395586477"}]},"ts":"1696395586477"} 2023-10-04 04:59:46,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 04:59:46,480 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 04:59:46,480 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395586480"}]},"ts":"1696395586480"} 2023-10-04 04:59:46,482 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 04:59:46,484 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 04:59:46,485 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 04:59:46,485 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 04:59:46,485 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 04:59:46,485 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 04:59:46,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, ASSIGN}] 2023-10-04 04:59:46,488 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, ASSIGN 2023-10-04 04:59:46,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, ASSIGN 2023-10-04 04:59:46,489 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 04:59:46,489 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 04:59:46,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 04:59:46,639 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 04:59:46,641 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=38c82e881b78afe1bb3be17ca42e6344, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:46,641 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9352b604ac5a4cd0491cdf10484f77f5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:46,642 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586641"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395586641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395586641"}]},"ts":"1696395586641"} 2023-10-04 04:59:46,642 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586641"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395586641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395586641"}]},"ts":"1696395586641"} 2023-10-04 04:59:46,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 38c82e881b78afe1bb3be17ca42e6344, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 04:59:46,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9352b604ac5a4cd0491cdf10484f77f5, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 04:59:46,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 04:59:46,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38c82e881b78afe1bb3be17ca42e6344, NAME => 'testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 04:59:46,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. service=AccessControlService 2023-10-04 04:59:46,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9352b604ac5a4cd0491cdf10484f77f5, NAME => 'testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 04:59:46,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. service=AccessControlService 2023-10-04 04:59:46,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,802 INFO [StoreOpener-38c82e881b78afe1bb3be17ca42e6344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,802 INFO [StoreOpener-9352b604ac5a4cd0491cdf10484f77f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,803 DEBUG [StoreOpener-9352b604ac5a4cd0491cdf10484f77f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf 2023-10-04 04:59:46,804 DEBUG [StoreOpener-38c82e881b78afe1bb3be17ca42e6344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf 2023-10-04 04:59:46,804 DEBUG [StoreOpener-38c82e881b78afe1bb3be17ca42e6344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf 2023-10-04 04:59:46,804 DEBUG [StoreOpener-9352b604ac5a4cd0491cdf10484f77f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf 2023-10-04 04:59:46,804 INFO [StoreOpener-38c82e881b78afe1bb3be17ca42e6344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38c82e881b78afe1bb3be17ca42e6344 columnFamilyName cf 2023-10-04 04:59:46,804 INFO [StoreOpener-9352b604ac5a4cd0491cdf10484f77f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9352b604ac5a4cd0491cdf10484f77f5 columnFamilyName cf 2023-10-04 04:59:46,806 INFO [StoreOpener-38c82e881b78afe1bb3be17ca42e6344-1] regionserver.HStore(310): Store=38c82e881b78afe1bb3be17ca42e6344/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:46,807 INFO [StoreOpener-9352b604ac5a4cd0491cdf10484f77f5-1] regionserver.HStore(310): Store=9352b604ac5a4cd0491cdf10484f77f5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 04:59:46,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 04:59:46,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 04:59:46,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:46,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 04:59:46,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9352b604ac5a4cd0491cdf10484f77f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64618469, jitterRate=-0.037109777331352234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:46,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 38c82e881b78afe1bb3be17ca42e6344; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68221339, jitterRate=0.01657716929912567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 04:59:46,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9352b604ac5a4cd0491cdf10484f77f5: 2023-10-04 04:59:46,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 38c82e881b78afe1bb3be17ca42e6344: 2023-10-04 04:59:46,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344., pid=30, masterSystemTime=1696395586796 2023-10-04 04:59:46,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5., pid=31, masterSystemTime=1696395586797 2023-10-04 04:59:46,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:46,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=38c82e881b78afe1bb3be17ca42e6344, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:46,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586824"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395586824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395586824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395586824"}]},"ts":"1696395586824"} 2023-10-04 04:59:46,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:46,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9352b604ac5a4cd0491cdf10484f77f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:46,826 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395586825"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395586825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395586825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395586825"}]},"ts":"1696395586825"} 2023-10-04 04:59:46,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-04 04:59:46,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 38c82e881b78afe1bb3be17ca42e6344, server=jenkins-hbase20.apache.org,46127,1696395563481 in 184 msec 2023-10-04 04:59:46,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-04 04:59:46,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9352b604ac5a4cd0491cdf10484f77f5, server=jenkins-hbase20.apache.org,35697,1696395563431 in 184 msec 2023-10-04 04:59:46,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, ASSIGN in 346 msec 2023-10-04 04:59:46,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-04 04:59:46,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, ASSIGN in 349 msec 2023-10-04 04:59:46,838 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 04:59:46,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395586838"}]},"ts":"1696395586838"} 2023-10-04 04:59:46,841 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 04:59:46,843 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 04:59:46,844 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-04 04:59:46,846 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 04:59:46,847 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,847 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,847 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,847 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 04:59:46,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:46,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:46,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:46,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 04:59:46,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 422 msec 2023-10-04 04:59:47,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 04:59:47,037 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-04 04:59:47,040 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 04:59:47,040 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,042 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 04:59:47,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395587057 (current time:1696395587057). 2023-10-04 04:59:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 04:59:47,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x78fdace6 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:47,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d8504d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:47,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,067 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78fdace6 to 127.0.0.1:60951 2023-10-04 04:59:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:47,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x54175407 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:47,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@411858ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:47,076 DEBUG [hconnection-0x245e6f81-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,079 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,084 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54175407 to 127.0.0.1:60951 2023-10-04 04:59:47,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:47,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 04:59:47,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 04:59:47,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,090 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 04:59:47,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,093 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,094 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696396187094 2023-10-04 04:59:47,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 04:59:47,095 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 04:59:47,095 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 04:59:47,097 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-04 04:59:47,100 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,101 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696396187101 2023-10-04 04:59:47,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,114 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-04 04:59:47,114 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,115 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 04:59:47,115 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 04:59:47,116 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,116 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,117 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,117 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,117 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,118 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,118 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,119 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,121 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,121 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,120 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,121 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,121 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,124 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,124 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@763160ba[Count = 1] remaining members to acquire global barrier 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 04:59:47,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@763160ba[Count = 0] remaining members to acquire global barrier 2023-10-04 04:59:47,128 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 04:59:47,128 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,129 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:47,130 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:47,129 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,130 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. started... 2023-10-04 04:59:47,130 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 04:59:47,130 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,130 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 04:59:47,130 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:47,130 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,130 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. started... 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38c82e881b78afe1bb3be17ca42e6344: 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9352b604ac5a4cd0491cdf10484f77f5: 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 04:59:47,131 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:47,132 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 04:59:47,132 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,132 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,132 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,159 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. completed. 2023-10-04 04:59:47,160 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,160 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. completed. 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:47,160 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 04:59:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 04:59:47,165 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,165 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,165 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,167 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,167 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,166 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,167 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,167 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 04:59:47,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 04:59:47,174 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-04 04:59:47,175 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 04:59:47,175 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 04:59:47,175 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,175 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,182 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,183 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,183 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,183 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,185 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,185 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,185 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,190 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 04:59:47,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,191 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,191 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 04:59:47,192 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,192 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,193 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,193 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,193 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,193 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 04:59:47,196 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:47,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 04:59:47,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:47,197 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 04:59:47,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 04:59:47,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,228 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 04:59:47,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696395587094Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696395587205 (+111 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696395587205Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696395587205Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696395587209 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696395587219 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696395587227 (+8 ms) 2023-10-04 04:59:47,230 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 135 msec 2023-10-04 04:59:47,397 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:47,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 04:59:47,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 04:59:47,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 04:59:47,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 04:59:47,412 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 04:59:47,412 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,412 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 04:59:47,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395587426 (current time:1696395587426). 2023-10-04 04:59:47,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 04:59:47,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x7919faba to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:47,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f7c58af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:47,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,437 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7919faba to 127.0.0.1:60951 2023-10-04 04:59:47,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:47,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x5f8439c0 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 04:59:47,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74da4000, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 04:59:47,451 DEBUG [hconnection-0x4747c58d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,452 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 04:59:47,460 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 04:59:47,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f8439c0 to 127.0.0.1:60951 2023-10-04 04:59:47,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 04:59:47,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 04:59:47,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 04:59:47,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,466 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 04:59:47,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,469 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,470 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696396187470 2023-10-04 04:59:47,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 04:59:47,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 04:59:47,472 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 04:59:47,472 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 04:59:47,473 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 04:59:47,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-04 04:59:47,476 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,477 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696396187477 2023-10-04 04:59:47,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-04 04:59:47,487 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-04 04:59:47,487 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,489 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 04:59:47,489 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 04:59:47,490 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,490 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,491 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,491 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,491 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,491 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,492 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 04:59:47,492 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 04:59:47,493 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,493 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,493 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 04:59:47,494 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,496 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 04:59:47,496 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 04:59:47,496 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,496 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 04:59:47,497 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 04:59:47,507 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,507 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,507 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,508 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,508 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,508 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,508 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,510 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,510 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,510 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,511 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 04:59:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66c67b26[Count = 1] remaining members to acquire global barrier 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 04:59:47,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66c67b26[Count = 0] remaining members to acquire global barrier 2023-10-04 04:59:47,514 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 04:59:47,514 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,520 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:47,521 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 04:59:47,521 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:47,521 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. started... 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:47,521 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,521 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 04:59:47,521 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 04:59:47,521 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9352b604ac5a4cd0491cdf10484f77f5 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 04:59:47,521 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. started... 2023-10-04 04:59:47,521 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 38c82e881b78afe1bb3be17ca42e6344 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 04:59:47,524 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,525 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,525 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,553 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf 2023-10-04 04:59:47,557 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0 2023-10-04 04:59:47,572 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:47,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 04:59:47,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 04:59:47,573 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 04:59:47,574 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/.tmp/cf/fd1a772c23004432b357d475328e7c66 2023-10-04 04:59:47,581 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/.tmp/cf/fd1a772c23004432b357d475328e7c66 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66 2023-10-04 04:59:47,583 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/.tmp/cf/3d2822fdace6487b83cbc71432ca22ef 2023-10-04 04:59:47,589 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 04:59:47,590 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9352b604ac5a4cd0491cdf10484f77f5 in 69ms, sequenceid=6, compaction requested=false 2023-10-04 04:59:47,591 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-04 04:59:47,591 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/.tmp/cf/3d2822fdace6487b83cbc71432ca22ef as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef 2023-10-04 04:59:47,591 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9352b604ac5a4cd0491cdf10484f77f5: 2023-10-04 04:59:47,591 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 04:59:47,592 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:47,592 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66] hfiles 2023-10-04 04:59:47,592 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66 for snapshot=snaptb0-testExportFileSystemState 2023-10-04 04:59:47,599 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef, entries=47, sequenceid=6, filesize=12.8 K 2023-10-04 04:59:47,600 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 38c82e881b78afe1bb3be17ca42e6344 in 79ms, sequenceid=6, compaction requested=false 2023-10-04 04:59:47,604 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38c82e881b78afe1bb3be17ca42e6344: 2023-10-04 04:59:47,604 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 04:59:47,604 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 04:59:47,604 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef] hfiles 2023-10-04 04:59:47,604 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef for snapshot=snaptb0-testExportFileSystemState 2023-10-04 04:59:47,614 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. completed. 2023-10-04 04:59:47,614 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 04:59:47,614 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:47,614 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:47,614 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,614 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,614 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 04:59:47,616 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,616 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,616 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,617 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 04:59:47,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 04:59:47,629 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. completed. 2023-10-04 04:59:47,629 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 04:59:47,629 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 04:59:47,629 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 04:59:47,629 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,629 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 04:59:47,629 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 04:59:47,630 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 04:59:47,630 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,630 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,630 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 04:59:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 04:59:47,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 04:59:47,635 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-04 04:59:47,635 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 04:59:47,635 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 04:59:47,635 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-04 04:59:47,635 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 04:59:47,636 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,637 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,637 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 04:59:47,637 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 04:59:47,639 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 04:59:47,639 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,640 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 04:59:47,644 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,644 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 04:59:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 04:59:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 04:59:47,643 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-04 04:59:47,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 04:59:47,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 04:59:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 04:59:47,644 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,645 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,644 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 04:59:47,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf] mob files 2023-10-04 04:59:47,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0 2023-10-04 04:59:47,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 04:59:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 04:59:47,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf 2023-10-04 04:59:47,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-04 04:59:47,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 04:59:47,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,692 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696395587470Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696395587661 (+191 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696395587661Loading Region manifests for snaptb0-testExportFileSystemState at 1696395587661Writing data manifest for snaptb0-testExportFileSystemState at 1696395587666 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696395587683 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696395587692 (+9 ms) 2023-10-04 04:59:47,695 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 04:59:47,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 224 msec 2023-10-04 04:59:47,773 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 04:59:47,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 04:59:47,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 04:59:47,775 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775 2023-10-04 04:59:47,775 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34757, tgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775, rawTgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:47,799 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 04:59:47,799 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1813366507_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,800 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-04 04:59:47,812 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 04:59:47,836 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,837 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,837 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,837 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,838 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,838 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,838 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,899 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-6649354940936158707.jar 2023-10-04 04:59:47,900 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,900 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,900 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,901 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,901 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,901 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 04:59:47,901 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 04:59:47,902 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 04:59:47,902 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 04:59:47,902 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 04:59:47,903 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 04:59:47,903 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 04:59:47,903 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 04:59:47,904 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 04:59:47,904 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 04:59:47,904 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 04:59:47,905 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:47,905 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:47,905 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:47,906 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:47,906 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 04:59:47,906 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:47,906 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 04:59:49,121 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 04:59:49,124 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-04 04:59:49,126 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 04:59:50,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 04:59:50,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 04:59:50,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0001_000001 (auth:SIMPLE) 2023-10-04 04:59:50,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0002_000001 (auth:SIMPLE) 2023-10-04 04:59:51,746 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 04:59:53,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0002_000001 (auth:SIMPLE) 2023-10-04 04:59:55,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0002_000001 (auth:SIMPLE) 2023-10-04 04:59:59,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0002_000001 (auth:SIMPLE) 2023-10-04 05:00:00,285 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:00:00,286 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:00:00,295 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-04 05:00:00,295 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:00:00,295 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:00:00,296 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 05:00:00,296 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 05:00:00,296 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 05:00:00,296 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 05:00:00,297 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 05:00:00,297 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395587775/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 05:00:00,305 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-04 05:00:00,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-10-04 05:00:00,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 05:00:00,311 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395600311"}]},"ts":"1696395600311"} 2023-10-04 05:00:00,313 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 05:00:00,314 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-04 05:00:00,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, UNASSIGN}] 2023-10-04 05:00:00,318 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, UNASSIGN 2023-10-04 05:00:00,318 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, UNASSIGN 2023-10-04 05:00:00,319 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9352b604ac5a4cd0491cdf10484f77f5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:00,319 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=38c82e881b78afe1bb3be17ca42e6344, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:00,319 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395600319"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395600319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395600319"}]},"ts":"1696395600319"} 2023-10-04 05:00:00,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395600319"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395600319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395600319"}]},"ts":"1696395600319"} 2023-10-04 05:00:00,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9352b604ac5a4cd0491cdf10484f77f5, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:00,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 38c82e881b78afe1bb3be17ca42e6344, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:00,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 05:00:00,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 05:00:00,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9352b604ac5a4cd0491cdf10484f77f5, disabling compactions & flushes 2023-10-04 05:00:00,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 05:00:00,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 05:00:00,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. after waiting 0 ms 2023-10-04 05:00:00,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 05:00:00,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 05:00:00,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 38c82e881b78afe1bb3be17ca42e6344, disabling compactions & flushes 2023-10-04 05:00:00,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 05:00:00,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 05:00:00,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. after waiting 0 ms 2023-10-04 05:00:00,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 05:00:00,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:00,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:00,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5. 2023-10-04 05:00:00,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9352b604ac5a4cd0491cdf10484f77f5: 2023-10-04 05:00:00,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:00,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:00,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344. 2023-10-04 05:00:00,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 38c82e881b78afe1bb3be17ca42e6344: 2023-10-04 05:00:00,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 05:00:00,492 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9352b604ac5a4cd0491cdf10484f77f5, regionState=CLOSED 2023-10-04 05:00:00,492 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395600492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395600492"}]},"ts":"1696395600492"} 2023-10-04 05:00:00,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 38c82e881b78afe1bb3be17ca42e6344 2023-10-04 05:00:00,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=38c82e881b78afe1bb3be17ca42e6344, regionState=CLOSED 2023-10-04 05:00:00,493 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696395600493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395600493"}]},"ts":"1696395600493"} 2023-10-04 05:00:00,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-04 05:00:00,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9352b604ac5a4cd0491cdf10484f77f5, server=jenkins-hbase20.apache.org,35697,1696395563431 in 173 msec 2023-10-04 05:00:00,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-04 05:00:00,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 38c82e881b78afe1bb3be17ca42e6344, server=jenkins-hbase20.apache.org,46127,1696395563481 in 174 msec 2023-10-04 05:00:00,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9352b604ac5a4cd0491cdf10484f77f5, UNASSIGN in 182 msec 2023-10-04 05:00:00,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-04 05:00:00,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=38c82e881b78afe1bb3be17ca42e6344, UNASSIGN in 182 msec 2023-10-04 05:00:00,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395600500"}]},"ts":"1696395600500"} 2023-10-04 05:00:00,502 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 05:00:00,503 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-04 05:00:00,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-10-04 05:00:00,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 05:00:00,613 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-04 05:00:00,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-10-04 05:00:00,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,617 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-04 05:00:00,618 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,620 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-04 05:00:00,621 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,621 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,621 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,622 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 05:00:00,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 05:00:00,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 05:00:00,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:00,623 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:00,624 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 05:00:00,624 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 05:00:00,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 05:00:00,626 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/recovered.edits] 2023-10-04 05:00:00,626 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/recovered.edits] 2023-10-04 05:00:00,630 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/cf/3d2822fdace6487b83cbc71432ca22ef 2023-10-04 05:00:00,630 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/cf/fd1a772c23004432b357d475328e7c66 2023-10-04 05:00:00,633 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5/recovered.edits/9.seqid 2023-10-04 05:00:00,633 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344/recovered.edits/9.seqid 2023-10-04 05:00:00,634 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/9352b604ac5a4cd0491cdf10484f77f5 2023-10-04 05:00:00,634 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemState/38c82e881b78afe1bb3be17ca42e6344 2023-10-04 05:00:00,634 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 05:00:00,635 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 05:00:00,635 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-04 05:00:00,639 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004346b129902b74e76b48d6f6df4c5efb0 2023-10-04 05:00:00,640 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100445a40e1a7c3549a7b4afe624d8721bdf 2023-10-04 05:00:00,641 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 05:00:00,643 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,646 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-04 05:00:00,649 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-04 05:00:00,651 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,651 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-04 05:00:00,651 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395600651"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:00,651 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395600651"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:00,654 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 05:00:00,655 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9352b604ac5a4cd0491cdf10484f77f5, NAME => 'testtb-testExportFileSystemState,,1696395586424.9352b604ac5a4cd0491cdf10484f77f5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 38c82e881b78afe1bb3be17ca42e6344, NAME => 'testtb-testExportFileSystemState,1,1696395586424.38c82e881b78afe1bb3be17ca42e6344.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 05:00:00,655 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-04 05:00:00,655 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395600655"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:00,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-04 05:00:00,666 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 05:00:00,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 53 msec 2023-10-04 05:00:00,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 05:00:00,726 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-04 05:00:00,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-04 05:00:00,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-04 05:00:00,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-10-04 05:00:00,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-04 05:00:00,774 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 755) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:34807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_599318197_1 at /127.0.0.1:34332 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:34348 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_599318197_1 at /127.0.0.1:38872 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:40743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:42032 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:38886 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=952 (was 943) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 192) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1210 (was 1288) 2023-10-04 05:00:00,775 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-04 05:00:00,797 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=952, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=166, AvailableMemoryMB=1208 2023-10-04 05:00:00,797 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-04 05:00:00,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 05:00:00,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:00,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 05:00:00,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-04 05:00:00,805 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 05:00:00,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 05:00:00,808 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:00,811 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:00,811 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb empty. 2023-10-04 05:00:00,812 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff empty. 2023-10-04 05:00:00,813 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:00,813 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:00,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 05:00:00,831 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-04 05:00:00,833 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 24bb77dc488039c3683062d892028fbb, NAME => 'testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:00,833 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a7b7309dd97d0cc12a82ae51e45f7eff, NAME => 'testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a7b7309dd97d0cc12a82ae51e45f7eff, disabling compactions & flushes 2023-10-04 05:00:00,855 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. after waiting 0 ms 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:00,855 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:00,855 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a7b7309dd97d0cc12a82ae51e45f7eff: 2023-10-04 05:00:00,864 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:00,864 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 24bb77dc488039c3683062d892028fbb, disabling compactions & flushes 2023-10-04 05:00:00,865 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:00,865 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:00,865 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. after waiting 0 ms 2023-10-04 05:00:00,865 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:00,865 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:00,865 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 24bb77dc488039c3683062d892028fbb: 2023-10-04 05:00:00,868 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 05:00:00,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395600869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395600869"}]},"ts":"1696395600869"} 2023-10-04 05:00:00,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395600869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395600869"}]},"ts":"1696395600869"} 2023-10-04 05:00:00,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 05:00:00,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 05:00:00,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395600874"}]},"ts":"1696395600874"} 2023-10-04 05:00:00,876 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-04 05:00:00,879 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 05:00:00,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 05:00:00,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 05:00:00,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 05:00:00,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 05:00:00,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, ASSIGN}] 2023-10-04 05:00:00,884 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, ASSIGN 2023-10-04 05:00:00,884 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, ASSIGN 2023-10-04 05:00:00,885 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 05:00:00,885 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41937,1696395563528; forceNewPlan=false, retain=false 2023-10-04 05:00:00,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 05:00:01,035 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 05:00:01,038 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a7b7309dd97d0cc12a82ae51e45f7eff, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=24bb77dc488039c3683062d892028fbb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395601038"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395601038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395601038"}]},"ts":"1696395601038"} 2023-10-04 05:00:01,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395601038"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395601038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395601038"}]},"ts":"1696395601038"} 2023-10-04 05:00:01,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 24bb77dc488039c3683062d892028fbb, server=jenkins-hbase20.apache.org,41937,1696395563528}] 2023-10-04 05:00:01,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure a7b7309dd97d0cc12a82ae51e45f7eff, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:01,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 05:00:01,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7b7309dd97d0cc12a82ae51e45f7eff, NAME => 'testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 05:00:01,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 24bb77dc488039c3683062d892028fbb, NAME => 'testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 05:00:01,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. service=AccessControlService 2023-10-04 05:00:01,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. service=AccessControlService 2023-10-04 05:00:01,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:01,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,199 INFO [StoreOpener-24bb77dc488039c3683062d892028fbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,199 INFO [StoreOpener-a7b7309dd97d0cc12a82ae51e45f7eff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,201 DEBUG [StoreOpener-a7b7309dd97d0cc12a82ae51e45f7eff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf 2023-10-04 05:00:01,201 DEBUG [StoreOpener-a7b7309dd97d0cc12a82ae51e45f7eff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf 2023-10-04 05:00:01,201 DEBUG [StoreOpener-24bb77dc488039c3683062d892028fbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf 2023-10-04 05:00:01,201 DEBUG [StoreOpener-24bb77dc488039c3683062d892028fbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf 2023-10-04 05:00:01,201 INFO [StoreOpener-a7b7309dd97d0cc12a82ae51e45f7eff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7b7309dd97d0cc12a82ae51e45f7eff columnFamilyName cf 2023-10-04 05:00:01,201 INFO [StoreOpener-24bb77dc488039c3683062d892028fbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24bb77dc488039c3683062d892028fbb columnFamilyName cf 2023-10-04 05:00:01,203 INFO [StoreOpener-24bb77dc488039c3683062d892028fbb-1] regionserver.HStore(310): Store=24bb77dc488039c3683062d892028fbb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:01,203 INFO [StoreOpener-a7b7309dd97d0cc12a82ae51e45f7eff-1] regionserver.HStore(310): Store=a7b7309dd97d0cc12a82ae51e45f7eff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:01,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:01,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:01,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:01,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a7b7309dd97d0cc12a82ae51e45f7eff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60575646, jitterRate=-0.097352534532547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:01,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 24bb77dc488039c3683062d892028fbb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59382763, jitterRate=-0.11512787640094757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:01,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a7b7309dd97d0cc12a82ae51e45f7eff: 2023-10-04 05:00:01,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 24bb77dc488039c3683062d892028fbb: 2023-10-04 05:00:01,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb., pid=45, masterSystemTime=1696395601192 2023-10-04 05:00:01,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff., pid=46, masterSystemTime=1696395601193 2023-10-04 05:00:01,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a7b7309dd97d0cc12a82ae51e45f7eff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395601213"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395601213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395601213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395601213"}]},"ts":"1696395601213"} 2023-10-04 05:00:01,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=24bb77dc488039c3683062d892028fbb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395601214"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395601214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395601214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395601214"}]},"ts":"1696395601214"} 2023-10-04 05:00:01,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-04 05:00:01,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure a7b7309dd97d0cc12a82ae51e45f7eff, server=jenkins-hbase20.apache.org,35697,1696395563431 in 174 msec 2023-10-04 05:00:01,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-04 05:00:01,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 24bb77dc488039c3683062d892028fbb, server=jenkins-hbase20.apache.org,41937,1696395563528 in 176 msec 2023-10-04 05:00:01,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, ASSIGN in 336 msec 2023-10-04 05:00:01,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-04 05:00:01,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, ASSIGN in 337 msec 2023-10-04 05:00:01,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 05:00:01,221 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395601221"}]},"ts":"1696395601221"} 2023-10-04 05:00:01,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-04 05:00:01,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 05:00:01,225 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-04 05:00:01,227 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 05:00:01,228 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:01,228 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:01,228 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:01,228 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:01,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:01,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:01,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:01,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:01,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 430 msec 2023-10-04 05:00:01,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 05:00:01,410 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-04 05:00:01,412 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 05:00:01,412 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,414 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:01,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395601429 (current time:1696395601429). 2023-10-04 05:00:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:01,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x2b1ea100 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:01,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56dcc2b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:01,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,438 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b1ea100 to 127.0.0.1:60951 2023-10-04 05:00:01,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:01,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x71853538 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:01,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fcd8ca9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:01,459 DEBUG [hconnection-0x1fb402a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,462 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,469 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71853538 to 127.0.0.1:60951 2023-10-04 05:00:01,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:01,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 05:00:01,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:01,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,474 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:01,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,478 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,479 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696396201479 2023-10-04 05:00:01,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 05:00:01,481 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:01,481 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:01,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:01,486 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-10-04 05:00:01,489 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:01,491 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696396201491 2023-10-04 05:00:01,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,503 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-04 05:00:01,503 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,505 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 05:00:01,505 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 05:00:01,505 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,506 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,506 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,506 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,506 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,507 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,507 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,507 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,508 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,508 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,508 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,508 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,516 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,516 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,516 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,519 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,519 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,520 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ed06999[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 05:00:01,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ed06999[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:01,524 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 05:00:01,524 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,534 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,534 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:01,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:01,534 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,535 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:01,535 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:01,535 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. started... 2023-10-04 05:00:01,535 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,535 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. started... 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b7309dd97d0cc12a82ae51e45f7eff: 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 24bb77dc488039c3683062d892028fbb: 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,536 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:01,537 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:01,537 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:01,540 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:01,540 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:01,540 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:01,563 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. completed. 2023-10-04 05:00:01,563 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,563 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:01,564 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:01,564 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. completed. 2023-10-04 05:00:01,564 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,564 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:01,564 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:01,564 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:01,565 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,567 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,567 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,568 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:01,568 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,41937,1696395563528': 2023-10-04 05:00:01,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 05:00:01,575 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-04 05:00:01,575 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:01,575 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:01,575 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,575 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:01,581 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:01,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:01,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:01,582 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,587 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,587 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,588 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,588 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,591 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,592 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,592 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 05:00:01,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:01,595 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:01,595 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,595 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,595 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,596 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,595 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,596 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,596 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 05:00:01,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:01,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,598 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 05:00:01,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,637 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:01,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696395601479Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696395601605 (+126 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696395601605Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696395601606 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696395601609 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696395601622 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696395601636 (+14 ms) 2023-10-04 05:00:01,639 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:01,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 159 msec 2023-10-04 05:00:01,782 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:01,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:01,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:01,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41937] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:01,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:01,793 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 05:00:01,793 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,793 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:01,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395601807 (current time:1696395601807). 2023-10-04 05:00:01,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:01,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x6a64b1b7 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:01,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@305d62d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:01,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,825 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a64b1b7 to 127.0.0.1:60951 2023-10-04 05:00:01,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:01,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x26105482 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:01,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69b6a0fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:01,843 DEBUG [hconnection-0x32a65cbb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,849 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:01,857 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26105482 to 127.0.0.1:60951 2023-10-04 05:00:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 05:00:01,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:01,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,862 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:01,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,865 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,866 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696396201866 2023-10-04 05:00:01,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 05:00:01,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 05:00:01,869 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:01,869 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:01,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:01,871 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 05:00:01,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-04 05:00:01,874 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:01,875 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696396201875 2023-10-04 05:00:01,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-04 05:00:01,892 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-04 05:00:01,892 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,894 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 05:00:01,894 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 05:00:01,894 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,894 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,895 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,895 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,896 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 05:00:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 05:00:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,898 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,898 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 05:00:01,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 05:00:01,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 05:00:01,904 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,904 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,904 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,904 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 05:00:01,905 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,905 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:01,904 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,906 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 05:00:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 05:00:01,907 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 05:00:01,911 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,911 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,911 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,912 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,912 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b9a3c2e[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:01,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:01,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 05:00:01,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b9a3c2e[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:01,916 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 05:00:01,916 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,923 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,923 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,923 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:01,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:01,924 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:01,924 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:01,924 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 05:00:01,925 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. started... 2023-10-04 05:00:01,925 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:01,925 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:01,925 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:01,925 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. started... 2023-10-04 05:00:01,925 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7b7309dd97d0cc12a82ae51e45f7eff 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 05:00:01,925 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 24bb77dc488039c3683062d892028fbb 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 05:00:01,928 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:01,928 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:01,928 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:01,960 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986 2023-10-04 05:00:01,965 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6 2023-10-04 05:00:01,969 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:01,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:01,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:01,971 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:01,986 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/.tmp/cf/446b338d43ad43b287c87236829ffd6a 2023-10-04 05:00:01,989 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/.tmp/cf/ca073f5c1b404f8fa251d6a1620dfe79 2023-10-04 05:00:01,992 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/.tmp/cf/446b338d43ad43b287c87236829ffd6a as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a 2023-10-04 05:00:01,995 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/.tmp/cf/ca073f5c1b404f8fa251d6a1620dfe79 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79 2023-10-04 05:00:01,999 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 05:00:02,002 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 24bb77dc488039c3683062d892028fbb in 77ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 05:00:02,003 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79, entries=47, sequenceid=6, filesize=12.7 K 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 24bb77dc488039c3683062d892028fbb: 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a] hfiles 2023-10-04 05:00:02,003 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a for snapshot=snaptb0-testConsecutiveExports 2023-10-04 05:00:02,004 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a7b7309dd97d0cc12a82ae51e45f7eff in 79ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:02,005 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7b7309dd97d0cc12a82ae51e45f7eff: 2023-10-04 05:00:02,006 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 05:00:02,006 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:02,006 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79] hfiles 2023-10-04 05:00:02,006 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 05:00:02,017 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. completed. 2023-10-04 05:00:02,017 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:02,017 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. completed. 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:02,017 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 05:00:02,017 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:02,018 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,018 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:02,018 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:02,019 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 05:00:02,019 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,020 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:02,019 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:02,020 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 05:00:02,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:02,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,41937,1696395563528': 2023-10-04 05:00:02,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 05:00:02,027 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-04 05:00:02,027 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:02,027 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:02,027 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-04 05:00:02,027 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:02,171 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:02,173 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,265 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,265 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,266 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,267 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,269 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:02,269 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 05:00:02,269 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,473 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:02,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:02,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:02,474 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-04 05:00:02,916 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:02,916 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:02,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:02,917 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:02,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:02,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:02,917 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-04 05:00:02,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 05:00:02,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 05:00:02,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:02,917 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,920 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:02,920 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:02,920 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,920 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:02,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986] mob files 2023-10-04 05:00:02,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6 2023-10-04 05:00:02,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986 2023-10-04 05:00:02,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-04 05:00:02,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 05:00:02,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,965 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696395601867Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696395602933 (+1066 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696395602933Loading Region manifests for snaptb0-testConsecutiveExports at 1696395602933Writing data manifest for snaptb0-testConsecutiveExports at 1696395602940 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696395602955 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696395602965 (+10 ms) 2023-10-04 05:00:02,968 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 05:00:02,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.1000 sec 2023-10-04 05:00:02,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:02,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 05:00:02,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:02,976 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976 2023-10-04 05:00:02,976 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:02,997 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:02,997 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@15ff773d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:02,997 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 05:00:03,008 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:03,021 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,022 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,022 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,023 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,023 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,024 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,024 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,108 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-2065749273455769694.jar 2023-10-04 05:00:03,109 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,109 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,110 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,110 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,111 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,111 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:03,112 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 05:00:03,112 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 05:00:03,113 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 05:00:03,113 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 05:00:03,114 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 05:00:03,114 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 05:00:03,115 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 05:00:03,115 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 05:00:03,116 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 05:00:03,116 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 05:00:03,117 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:03,117 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:03,118 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:03,118 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:03,118 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:03,119 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:03,119 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:03,964 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 05:00:03,966 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 05:00:03,968 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 05:00:05,340 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:05,341 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:05,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0002_000001 (auth:SIMPLE) 2023-10-04 05:00:06,062 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 05:00:06,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0003_000001 (auth:SIMPLE) 2023-10-04 05:00:09,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0003_000001 (auth:SIMPLE) 2023-10-04 05:00:11,729 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0003_000001 (auth:SIMPLE) 2023-10-04 05:00:13,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0003_000001 (auth:SIMPLE) 2023-10-04 05:00:15,159 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:00:15,159 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:00:15,163 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 05:00:15,163 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:00:15,164 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:00:15,164 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 05:00:15,166 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 05:00:15,166 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 05:00:15,166 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@420deab1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 05:00:15,166 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 05:00:15,166 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 05:00:15,167 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:15,185 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:15,185 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6d8827a6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:15,185 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 05:00:15,195 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 05:00:15,206 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,206 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,207 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,207 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,207 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,208 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,208 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,265 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-8944167322394507337.jar 2023-10-04 05:00:15,266 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,266 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,266 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,266 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,267 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,267 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:15,267 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 05:00:15,268 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 05:00:15,268 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 05:00:15,268 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 05:00:15,268 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 05:00:15,269 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 05:00:15,269 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 05:00:15,269 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 05:00:15,270 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 05:00:15,270 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 05:00:15,270 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:15,270 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:15,271 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:15,271 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:15,271 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:15,271 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:15,272 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:15,615 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 05:00:15,617 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 05:00:15,619 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 05:00:19,896 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:19,896 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:19,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0003_000001 (auth:SIMPLE) 2023-10-04 05:00:20,364 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0004_000001 (auth:SIMPLE) 2023-10-04 05:00:23,762 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0004_000001 (auth:SIMPLE) 2023-10-04 05:00:25,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0004_000001 (auth:SIMPLE) 2023-10-04 05:00:28,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0004_000001 (auth:SIMPLE) 2023-10-04 05:00:28,396 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696395569426_0004_01_000002 is : 143 2023-10-04 05:00:29,808 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:00:29,808 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:00:29,811 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 05:00:29,811 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:00:29,811 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:00:29,811 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 05:00:29,814 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 05:00:29,814 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 05:00:29,814 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@420deab1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 05:00:29,814 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 05:00:29,814 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/local-export-1696395602976/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 05:00:29,825 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-04 05:00:29,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-10-04 05:00:29,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 05:00:29,829 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395629829"}]},"ts":"1696395629829"} 2023-10-04 05:00:29,830 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-04 05:00:29,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 05:00:29,948 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-04 05:00:29,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, UNASSIGN}] 2023-10-04 05:00:29,956 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, UNASSIGN 2023-10-04 05:00:29,956 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, UNASSIGN 2023-10-04 05:00:29,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=24bb77dc488039c3683062d892028fbb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:29,958 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a7b7309dd97d0cc12a82ae51e45f7eff, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:29,958 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395629958"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395629958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395629958"}]},"ts":"1696395629958"} 2023-10-04 05:00:29,958 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395629958"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395629958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395629958"}]},"ts":"1696395629958"} 2023-10-04 05:00:29,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 24bb77dc488039c3683062d892028fbb, server=jenkins-hbase20.apache.org,41937,1696395563528}] 2023-10-04 05:00:29,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure a7b7309dd97d0cc12a82ae51e45f7eff, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:30,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:30,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 24bb77dc488039c3683062d892028fbb, disabling compactions & flushes 2023-10-04 05:00:30,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:30,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:30,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:30,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. after waiting 0 ms 2023-10-04 05:00:30,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:30,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a7b7309dd97d0cc12a82ae51e45f7eff, disabling compactions & flushes 2023-10-04 05:00:30,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:30,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:30,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. after waiting 0 ms 2023-10-04 05:00:30,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:30,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 05:00:30,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:30,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:30,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:30,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:30,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff. 2023-10-04 05:00:30,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a7b7309dd97d0cc12a82ae51e45f7eff: 2023-10-04 05:00:30,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb. 2023-10-04 05:00:30,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 24bb77dc488039c3683062d892028fbb: 2023-10-04 05:00:30,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:30,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=24bb77dc488039c3683062d892028fbb, regionState=CLOSED 2023-10-04 05:00:30,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395630138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395630138"}]},"ts":"1696395630138"} 2023-10-04 05:00:30,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:30,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a7b7309dd97d0cc12a82ae51e45f7eff, regionState=CLOSED 2023-10-04 05:00:30,139 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696395630139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395630139"}]},"ts":"1696395630139"} 2023-10-04 05:00:30,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-04 05:00:30,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 24bb77dc488039c3683062d892028fbb, server=jenkins-hbase20.apache.org,41937,1696395563528 in 180 msec 2023-10-04 05:00:30,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-04 05:00:30,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24bb77dc488039c3683062d892028fbb, UNASSIGN in 192 msec 2023-10-04 05:00:30,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure a7b7309dd97d0cc12a82ae51e45f7eff, server=jenkins-hbase20.apache.org,35697,1696395563431 in 180 msec 2023-10-04 05:00:30,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-04 05:00:30,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a7b7309dd97d0cc12a82ae51e45f7eff, UNASSIGN in 194 msec 2023-10-04 05:00:30,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395630146"}]},"ts":"1696395630146"} 2023-10-04 05:00:30,147 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-04 05:00:30,148 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-04 05:00:30,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 324 msec 2023-10-04 05:00:30,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 05:00:30,435 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-04 05:00:30,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-10-04 05:00:30,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,442 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-04 05:00:30,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,445 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-04 05:00:30,447 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,447 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,447 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,447 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 05:00:30,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 05:00:30,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 05:00:30,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 05:00:30,448 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:30,448 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:30,449 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:30,448 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 05:00:30,450 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/recovered.edits] 2023-10-04 05:00:30,451 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/recovered.edits] 2023-10-04 05:00:30,454 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/cf/446b338d43ad43b287c87236829ffd6a 2023-10-04 05:00:30,454 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/cf/ca073f5c1b404f8fa251d6a1620dfe79 2023-10-04 05:00:30,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb/recovered.edits/9.seqid 2023-10-04 05:00:30,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff/recovered.edits/9.seqid 2023-10-04 05:00:30,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/24bb77dc488039c3683062d892028fbb 2023-10-04 05:00:30,458 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testConsecutiveExports/a7b7309dd97d0cc12a82ae51e45f7eff 2023-10-04 05:00:30,458 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 05:00:30,458 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 05:00:30,459 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-04 05:00:30,461 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004d6eb757b0e764cb5a61bdf42228d43e6 2023-10-04 05:00:30,463 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004da9b38d5a4984b189c9661828c813986 2023-10-04 05:00:30,463 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 05:00:30,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,467 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-04 05:00:30,469 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-04 05:00:30,471 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,471 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-04 05:00:30,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395630471"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:30,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395630471"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:30,473 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 05:00:30,473 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 24bb77dc488039c3683062d892028fbb, NAME => 'testtb-testConsecutiveExports,,1696395600799.24bb77dc488039c3683062d892028fbb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a7b7309dd97d0cc12a82ae51e45f7eff, NAME => 'testtb-testConsecutiveExports,1,1696395600799.a7b7309dd97d0cc12a82ae51e45f7eff.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 05:00:30,473 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-04 05:00:30,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395630473"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:30,476 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-04 05:00:30,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 05:00:30,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 39 msec 2023-10-04 05:00:30,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 05:00:30,551 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-04 05:00:30,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-04 05:00:30,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-04 05:00:30,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-10-04 05:00:30,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-04 05:00:30,587 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759 (was 764), OpenFileDescriptor=937 (was 952), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1036 (was 1208) 2023-10-04 05:00:30,588 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-04 05:00:30,609 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=166, AvailableMemoryMB=1035 2023-10-04 05:00:30,609 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-04 05:00:30,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 05:00:30,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:30,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 05:00:30,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-04 05:00:30,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 05:00:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 05:00:30,618 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,618 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,619 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 empty. 2023-10-04 05:00:30,619 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa empty. 2023-10-04 05:00:30,619 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,619 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,619 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 05:00:30,632 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-04 05:00:30,634 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca38d317994888a765c027d285c101c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:30,634 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a2fc541ca3e5cd334c9e66ae65f955aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a2fc541ca3e5cd334c9e66ae65f955aa, disabling compactions & flushes 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ca38d317994888a765c027d285c101c8, disabling compactions & flushes 2023-10-04 05:00:30,645 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:30,645 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. after waiting 0 ms 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. after waiting 0 ms 2023-10-04 05:00:30,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:30,646 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:30,646 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:30,646 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:30,646 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a2fc541ca3e5cd334c9e66ae65f955aa: 2023-10-04 05:00:30,646 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ca38d317994888a765c027d285c101c8: 2023-10-04 05:00:30,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 05:00:30,651 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395630651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395630651"}]},"ts":"1696395630651"} 2023-10-04 05:00:30,651 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395630651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395630651"}]},"ts":"1696395630651"} 2023-10-04 05:00:30,657 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 05:00:30,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 05:00:30,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395630658"}]},"ts":"1696395630658"} 2023-10-04 05:00:30,659 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-04 05:00:30,661 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 05:00:30,662 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 05:00:30,662 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 05:00:30,662 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 05:00:30,662 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 05:00:30,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, ASSIGN}] 2023-10-04 05:00:30,665 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, ASSIGN 2023-10-04 05:00:30,665 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, ASSIGN 2023-10-04 05:00:30,665 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 05:00:30,665 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 05:00:30,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 05:00:30,816 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 05:00:30,819 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a2fc541ca3e5cd334c9e66ae65f955aa, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:30,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca38d317994888a765c027d285c101c8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:30,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395630819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395630819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395630819"}]},"ts":"1696395630819"} 2023-10-04 05:00:30,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395630819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395630819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395630819"}]},"ts":"1696395630819"} 2023-10-04 05:00:30,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure a2fc541ca3e5cd334c9e66ae65f955aa, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:30,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ca38d317994888a765c027d285c101c8, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:30,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 05:00:30,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2fc541ca3e5cd334c9e66ae65f955aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 05:00:30,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca38d317994888a765c027d285c101c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 05:00:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. service=AccessControlService 2023-10-04 05:00:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. service=AccessControlService 2023-10-04 05:00:30,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:30,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,987 INFO [StoreOpener-a2fc541ca3e5cd334c9e66ae65f955aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,987 INFO [StoreOpener-ca38d317994888a765c027d285c101c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,989 DEBUG [StoreOpener-ca38d317994888a765c027d285c101c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf 2023-10-04 05:00:30,989 DEBUG [StoreOpener-ca38d317994888a765c027d285c101c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf 2023-10-04 05:00:30,989 DEBUG [StoreOpener-a2fc541ca3e5cd334c9e66ae65f955aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf 2023-10-04 05:00:30,989 DEBUG [StoreOpener-a2fc541ca3e5cd334c9e66ae65f955aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf 2023-10-04 05:00:30,990 INFO [StoreOpener-ca38d317994888a765c027d285c101c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca38d317994888a765c027d285c101c8 columnFamilyName cf 2023-10-04 05:00:30,990 INFO [StoreOpener-a2fc541ca3e5cd334c9e66ae65f955aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2fc541ca3e5cd334c9e66ae65f955aa columnFamilyName cf 2023-10-04 05:00:30,996 INFO [StoreOpener-ca38d317994888a765c027d285c101c8-1] regionserver.HStore(310): Store=ca38d317994888a765c027d285c101c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:30,996 INFO [StoreOpener-a2fc541ca3e5cd334c9e66ae65f955aa-1] regionserver.HStore(310): Store=a2fc541ca3e5cd334c9e66ae65f955aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:30,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:30,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:30,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:31,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:31,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ca38d317994888a765c027d285c101c8 2023-10-04 05:00:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:31,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a2fc541ca3e5cd334c9e66ae65f955aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63986412, jitterRate=-0.046528160572052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:31,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ca38d317994888a765c027d285c101c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63570721, jitterRate=-0.05272243916988373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a2fc541ca3e5cd334c9e66ae65f955aa: 2023-10-04 05:00:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ca38d317994888a765c027d285c101c8: 2023-10-04 05:00:31,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa., pid=60, masterSystemTime=1696395630975 2023-10-04 05:00:31,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8., pid=61, masterSystemTime=1696395630976 2023-10-04 05:00:31,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca38d317994888a765c027d285c101c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395631006"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395631006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395631006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395631006"}]},"ts":"1696395631006"} 2023-10-04 05:00:31,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a2fc541ca3e5cd334c9e66ae65f955aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395631006"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395631006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395631006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395631006"}]},"ts":"1696395631006"} 2023-10-04 05:00:31,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-04 05:00:31,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ca38d317994888a765c027d285c101c8, server=jenkins-hbase20.apache.org,35697,1696395563431 in 184 msec 2023-10-04 05:00:31,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-04 05:00:31,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure a2fc541ca3e5cd334c9e66ae65f955aa, server=jenkins-hbase20.apache.org,46127,1696395563481 in 186 msec 2023-10-04 05:00:31,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, ASSIGN in 347 msec 2023-10-04 05:00:31,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-04 05:00:31,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, ASSIGN in 348 msec 2023-10-04 05:00:31,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 05:00:31,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395631012"}]},"ts":"1696395631012"} 2023-10-04 05:00:31,013 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-04 05:00:31,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 05:00:31,015 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-04 05:00:31,017 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 05:00:31,018 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:31,018 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:31,018 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:31,018 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:31,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:31,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:31,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:31,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:31,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 408 msec 2023-10-04 05:00:31,025 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-04 05:00:31,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 05:00:31,222 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-04 05:00:31,226 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,226 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,228 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:31,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395631245 (current time:1696395631245). 2023-10-04 05:00:31,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x542cd8c5 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:31,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67fa7c77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:31,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,255 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x542cd8c5 to 127.0.0.1:60951 2023-10-04 05:00:31,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x15e35fba to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:31,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27bb4733, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:31,265 DEBUG [hconnection-0x13168e77-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,266 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,275 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15e35fba to 127.0.0.1:60951 2023-10-04 05:00:31,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:31,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 05:00:31,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:31,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,279 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:31,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,282 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,282 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696396231282 2023-10-04 05:00:31,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,284 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:31,284 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:31,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,285 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-04 05:00:31,288 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,288 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696396231288 2023-10-04 05:00:31,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,299 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 05:00:31,299 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,300 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 05:00:31,300 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 05:00:31,301 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,301 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,302 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,302 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,302 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,302 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,302 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,302 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:31,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,303 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,305 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,306 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,306 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,304 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,306 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,307 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418339be[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 05:00:31,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418339be[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:31,312 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 05:00:31,312 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,313 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:31,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:31,313 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,313 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,314 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:31,313 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,314 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:31,314 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,314 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:31,314 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. started... 2023-10-04 05:00:31,314 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. started... 2023-10-04 05:00:31,315 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca38d317994888a765c027d285c101c8: 2023-10-04 05:00:31,315 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2fc541ca3e5cd334c9e66ae65f955aa: 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:31,316 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:31,316 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,316 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,316 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,332 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. completed. 2023-10-04 05:00:31,332 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. completed. 2023-10-04 05:00:31,332 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,332 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:31,332 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:31,333 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,333 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,335 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,335 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:31,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 05:00:31,344 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 05:00:31,344 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:31,344 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:31,344 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,344 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,348 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,347 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,348 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,349 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,351 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,351 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,351 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,369 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,369 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,369 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,369 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,369 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,370 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,370 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,370 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,371 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 05:00:31,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,384 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:31,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 05:00:31,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:31,386 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:31,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 05:00:31,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,408 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696395631283Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696395631382 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696395631382Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696395631382Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696395631385 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696395631398 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696395631408 (+10 ms) 2023-10-04 05:00:31,410 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 126 msec 2023-10-04 05:00:31,586 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:31,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 05:00:31,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:31,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:31,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:31,601 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,601 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,601 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:31,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395631611 (current time:1696395631611). 2023-10-04 05:00:31,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:31,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x1df3b894 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:31,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282aa6f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:31,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,620 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1df3b894 to 127.0.0.1:60951 2023-10-04 05:00:31,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:31,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x4df429e5 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:31,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dc30fd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:31,634 DEBUG [hconnection-0x30a31594-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,638 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:31,647 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:31,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4df429e5 to 127.0.0.1:60951 2023-10-04 05:00:31,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:31,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 05:00:31,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:31,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,653 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:31,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,657 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,657 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696396231657 2023-10-04 05:00:31,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 05:00:31,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,659 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:31,659 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:31,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,660 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 05:00:31,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-04 05:00:31,662 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,662 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696396231662 2023-10-04 05:00:31,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,672 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 05:00:31,672 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,673 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 05:00:31,673 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 05:00:31,674 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,674 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,675 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,675 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,675 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,676 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,676 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,676 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,677 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,677 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,677 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,678 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,678 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 05:00:31,678 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,678 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:31,678 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,679 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 05:00:31,679 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,679 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 05:00:31,679 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,679 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 05:00:31,685 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,685 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,685 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,685 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,685 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,685 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db9448d[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 05:00:31,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db9448d[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:31,691 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 05:00:31,691 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,694 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:31,694 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,694 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:31,694 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,694 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. started... 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:31,694 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 05:00:31,695 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a2fc541ca3e5cd334c9e66ae65f955aa 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:31,695 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,695 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. started... 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,695 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca38d317994888a765c027d285c101c8 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-04 05:00:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,723 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d 2023-10-04 05:00:31,724 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77 2023-10-04 05:00:31,736 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/.tmp/cf/0be8fdb0421a4c22a2438ccfd71a2efb 2023-10-04 05:00:31,736 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/.tmp/cf/5fef2d89a55449619ffd5f03c832986b 2023-10-04 05:00:31,741 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/.tmp/cf/0be8fdb0421a4c22a2438ccfd71a2efb as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb 2023-10-04 05:00:31,741 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/.tmp/cf/5fef2d89a55449619ffd5f03c832986b as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b 2023-10-04 05:00:31,745 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb, entries=1, sequenceid=6, filesize=5.1 K 2023-10-04 05:00:31,745 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b, entries=49, sequenceid=6, filesize=13.9 K 2023-10-04 05:00:31,746 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for ca38d317994888a765c027d285c101c8 in 51ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:31,746 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for a2fc541ca3e5cd334c9e66ae65f955aa in 52ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca38d317994888a765c027d285c101c8: 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2fc541ca3e5cd334c9e66ae65f955aa: 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb] hfiles 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b] hfiles 2023-10-04 05:00:31,748 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,759 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:31,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 05:00:31,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:31,760 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. completed. 2023-10-04 05:00:31,760 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:31,760 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:31,760 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:31,760 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,761 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. completed. 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,761 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 05:00:31,761 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:31,762 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,762 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,762 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,762 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,763 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,763 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 05:00:31,764 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,764 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 05:00:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:31,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 05:00:31,770 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 05:00:31,770 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:31,770 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:31,770 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,770 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:31,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,778 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,777 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,778 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,779 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:31,780 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,781 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,781 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,784 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,784 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,784 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,784 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:31,784 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:31,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,785 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,787 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:31,787 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:31,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:31,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d] mob files 2023-10-04 05:00:31,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77 2023-10-04 05:00:31,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d 2023-10-04 05:00:31,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 05:00:31,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,824 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:31,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696395631658Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696395631798 (+140 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696395631798Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696395631798Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696395631802 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696395631813 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696395631823 (+10 ms) 2023-10-04 05:00:31,826 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 05:00:31,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 167 msec 2023-10-04 05:00:31,961 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:31,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 05:00:31,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:31,994 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 05:00:31,998 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 05:00:32,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 05:00:32,001 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 05:00:32,005 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 05:00:32,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41937] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 05:00:32,006 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 05:00:32,009 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 05:00:32,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 05:00:32,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 05:00:32,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:32,014 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 05:00:32,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-04 05:00:32,015 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 05:00:32,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 05:00:32,017 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,017 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 empty. 2023-10-04 05:00:32,018 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 empty. 2023-10-04 05:00:32,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,018 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 05:00:32,026 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-04 05:00:32,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff3f822ede64e54b774bbc447946d8d0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:32,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d22692621701486089b67ba203ab1969, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d22692621701486089b67ba203ab1969, disabling compactions & flushes 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ff3f822ede64e54b774bbc447946d8d0, disabling compactions & flushes 2023-10-04 05:00:32,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. after waiting 0 ms 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. after waiting 0 ms 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d22692621701486089b67ba203ab1969: 2023-10-04 05:00:32,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ff3f822ede64e54b774bbc447946d8d0: 2023-10-04 05:00:32,038 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 05:00:32,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395632039"}]},"ts":"1696395632039"} 2023-10-04 05:00:32,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395632039"}]},"ts":"1696395632039"} 2023-10-04 05:00:32,041 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 05:00:32,042 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 05:00:32,042 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395632042"}]},"ts":"1696395632042"} 2023-10-04 05:00:32,043 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-04 05:00:32,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 05:00:32,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 05:00:32,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 05:00:32,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 05:00:32,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 05:00:32,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, ASSIGN}] 2023-10-04 05:00:32,049 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, ASSIGN 2023-10-04 05:00:32,049 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, ASSIGN 2023-10-04 05:00:32,050 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 05:00:32,050 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 05:00:32,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 05:00:32,200 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 05:00:32,206 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d22692621701486089b67ba203ab1969, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:32,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff3f822ede64e54b774bbc447946d8d0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:32,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632206"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395632206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395632206"}]},"ts":"1696395632206"} 2023-10-04 05:00:32,207 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632206"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395632206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395632206"}]},"ts":"1696395632206"} 2023-10-04 05:00:32,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure d22692621701486089b67ba203ab1969, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:32,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure ff3f822ede64e54b774bbc447946d8d0, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:32,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 05:00:32,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff3f822ede64e54b774bbc447946d8d0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.', STARTKEY => '2', ENDKEY => ''} 2023-10-04 05:00:32,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d22692621701486089b67ba203ab1969, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.', STARTKEY => '', ENDKEY => '2'} 2023-10-04 05:00:32,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. service=AccessControlService 2023-10-04 05:00:32,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. service=AccessControlService 2023-10-04 05:00:32,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:32,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,370 INFO [StoreOpener-d22692621701486089b67ba203ab1969-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,370 INFO [StoreOpener-ff3f822ede64e54b774bbc447946d8d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,372 DEBUG [StoreOpener-d22692621701486089b67ba203ab1969-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf 2023-10-04 05:00:32,372 DEBUG [StoreOpener-ff3f822ede64e54b774bbc447946d8d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf 2023-10-04 05:00:32,372 DEBUG [StoreOpener-ff3f822ede64e54b774bbc447946d8d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf 2023-10-04 05:00:32,372 DEBUG [StoreOpener-d22692621701486089b67ba203ab1969-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf 2023-10-04 05:00:32,373 INFO [StoreOpener-d22692621701486089b67ba203ab1969-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d22692621701486089b67ba203ab1969 columnFamilyName cf 2023-10-04 05:00:32,373 INFO [StoreOpener-ff3f822ede64e54b774bbc447946d8d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff3f822ede64e54b774bbc447946d8d0 columnFamilyName cf 2023-10-04 05:00:32,373 INFO [StoreOpener-ff3f822ede64e54b774bbc447946d8d0-1] regionserver.HStore(310): Store=ff3f822ede64e54b774bbc447946d8d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:32,373 INFO [StoreOpener-d22692621701486089b67ba203ab1969-1] regionserver.HStore(310): Store=d22692621701486089b67ba203ab1969/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:32,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:32,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:32,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d22692621701486089b67ba203ab1969; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75365670, jitterRate=0.12303599715232849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:32,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ff3f822ede64e54b774bbc447946d8d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71083245, jitterRate=0.05922289192676544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:32,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d22692621701486089b67ba203ab1969: 2023-10-04 05:00:32,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ff3f822ede64e54b774bbc447946d8d0: 2023-10-04 05:00:32,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969., pid=69, masterSystemTime=1696395632360 2023-10-04 05:00:32,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0., pid=70, masterSystemTime=1696395632360 2023-10-04 05:00:32,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff3f822ede64e54b774bbc447946d8d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:32,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,386 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632386"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395632386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395632386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395632386"}]},"ts":"1696395632386"} 2023-10-04 05:00:32,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d22692621701486089b67ba203ab1969, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:32,387 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632386"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395632386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395632386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395632386"}]},"ts":"1696395632386"} 2023-10-04 05:00:32,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-04 05:00:32,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure ff3f822ede64e54b774bbc447946d8d0, server=jenkins-hbase20.apache.org,35697,1696395563431 in 178 msec 2023-10-04 05:00:32,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-04 05:00:32,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure d22692621701486089b67ba203ab1969, server=jenkins-hbase20.apache.org,46127,1696395563481 in 179 msec 2023-10-04 05:00:32,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, ASSIGN in 343 msec 2023-10-04 05:00:32,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-04 05:00:32,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, ASSIGN in 344 msec 2023-10-04 05:00:32,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 05:00:32,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395632392"}]},"ts":"1696395632392"} 2023-10-04 05:00:32,393 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-04 05:00:32,394 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 05:00:32,395 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-04 05:00:32,396 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 05:00:32,397 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:32,397 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:32,397 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:32,397 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:32,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 387 msec 2023-10-04 05:00:32,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 05:00:32,623 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-04 05:00:32,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0], force=true 2023-10-04 05:00:32,663 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0], force=true 2023-10-04 05:00:32,663 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0], force=true 2023-10-04 05:00:32,664 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0], force=true 2023-10-04 05:00:32,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 05:00:32,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, UNASSIGN}] 2023-10-04 05:00:32,688 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, UNASSIGN 2023-10-04 05:00:32,689 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, UNASSIGN 2023-10-04 05:00:32,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d22692621701486089b67ba203ab1969, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:32,689 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff3f822ede64e54b774bbc447946d8d0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:32,689 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632689"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395632689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395632689"}]},"ts":"1696395632689"} 2023-10-04 05:00:32,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632689"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395632689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395632689"}]},"ts":"1696395632689"} 2023-10-04 05:00:32,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d22692621701486089b67ba203ab1969, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:32,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ff3f822ede64e54b774bbc447946d8d0, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:32,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 05:00:32,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d22692621701486089b67ba203ab1969, disabling compactions & flushes 2023-10-04 05:00:32,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ff3f822ede64e54b774bbc447946d8d0, disabling compactions & flushes 2023-10-04 05:00:32,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. after waiting 0 ms 2023-10-04 05:00:32,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ff3f822ede64e54b774bbc447946d8d0 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 05:00:32,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. after waiting 0 ms 2023-10-04 05:00:32,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing d22692621701486089b67ba203ab1969 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 05:00:32,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/.tmp/cf/a36fe5c8fc9f4ac4bd1997092061c09d 2023-10-04 05:00:32,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/.tmp/cf/aa065276a66a4864bb5ac4573096c6e7 2023-10-04 05:00:32,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/.tmp/cf/aa065276a66a4864bb5ac4573096c6e7 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7 2023-10-04 05:00:32,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/.tmp/cf/a36fe5c8fc9f4ac4bd1997092061c09d as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d 2023-10-04 05:00:32,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 05:00:32,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 05:00:32,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ff3f822ede64e54b774bbc447946d8d0 in 34ms, sequenceid=5, compaction requested=false 2023-10-04 05:00:32,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d22692621701486089b67ba203ab1969 in 33ms, sequenceid=5, compaction requested=false 2023-10-04 05:00:32,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 05:00:32,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 05:00:32,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 05:00:32,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 05:00:32,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:32,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:32,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969. 2023-10-04 05:00:32,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0. 2023-10-04 05:00:32,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d22692621701486089b67ba203ab1969: 2023-10-04 05:00:32,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ff3f822ede64e54b774bbc447946d8d0: 2023-10-04 05:00:32,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d22692621701486089b67ba203ab1969 2023-10-04 05:00:32,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d22692621701486089b67ba203ab1969, regionState=CLOSED 2023-10-04 05:00:32,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395632892"}]},"ts":"1696395632892"} 2023-10-04 05:00:32,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:32,893 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff3f822ede64e54b774bbc447946d8d0, regionState=CLOSED 2023-10-04 05:00:32,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696395632893"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395632893"}]},"ts":"1696395632893"} 2023-10-04 05:00:32,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-04 05:00:32,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d22692621701486089b67ba203ab1969, server=jenkins-hbase20.apache.org,46127,1696395563481 in 203 msec 2023-10-04 05:00:32,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-04 05:00:32,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ff3f822ede64e54b774bbc447946d8d0, server=jenkins-hbase20.apache.org,35697,1696395563431 in 203 msec 2023-10-04 05:00:32,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d22692621701486089b67ba203ab1969, UNASSIGN in 213 msec 2023-10-04 05:00:32,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-04 05:00:32,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff3f822ede64e54b774bbc447946d8d0, UNASSIGN in 210 msec 2023-10-04 05:00:32,936 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-04 05:00:32,937 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632011.d22692621701486089b67ba203ab1969.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:32,937 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696395632011.ff3f822ede64e54b774bbc447946d8d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:32,938 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:32,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 05:00:32,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, ASSIGN}] 2023-10-04 05:00:32,980 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, ASSIGN 2023-10-04 05:00:32,981 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 05:00:33,131 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 05:00:33,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c4c4cc5dc09b0c3a7517b6788625e266, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,135 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696395633135"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395633135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395633135"}]},"ts":"1696395633135"} 2023-10-04 05:00:33,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c4c4cc5dc09b0c3a7517b6788625e266, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:33,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 05:00:33,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:33,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4c4cc5dc09b0c3a7517b6788625e266, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.', STARTKEY => '', ENDKEY => ''} 2023-10-04 05:00:33,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. service=AccessControlService 2023-10-04 05:00:33,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:33,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:33,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/.regioninfo 2023-10-04 05:00:33,310 INFO [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,311 DEBUG [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf 2023-10-04 05:00:33,311 DEBUG [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf 2023-10-04 05:00:33,311 INFO [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4c4cc5dc09b0c3a7517b6788625e266 columnFamilyName cf 2023-10-04 05:00:33,336 DEBUG [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] regionserver.HStore(539): loaded hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/a36fe5c8fc9f4ac4bd1997092061c09d.ff3f822ede64e54b774bbc447946d8d0->hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d-top 2023-10-04 05:00:33,342 DEBUG [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] regionserver.HStore(539): loaded hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/aa065276a66a4864bb5ac4573096c6e7.d22692621701486089b67ba203ab1969->hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7-top 2023-10-04 05:00:33,343 INFO [StoreOpener-c4c4cc5dc09b0c3a7517b6788625e266-1] regionserver.HStore(310): Store=c4c4cc5dc09b0c3a7517b6788625e266/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:33,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:33,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c4c4cc5dc09b0c3a7517b6788625e266; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68652281, jitterRate=0.022998705506324768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:33,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c4c4cc5dc09b0c3a7517b6788625e266: 2023-10-04 05:00:33,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266., pid=77, masterSystemTime=1696395633292 2023-10-04 05:00:33,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.,because compaction is disabled. 2023-10-04 05:00:33,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:33,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:33,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c4c4cc5dc09b0c3a7517b6788625e266, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,351 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696395633351"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395633351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395633351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395633351"}]},"ts":"1696395633351"} 2023-10-04 05:00:33,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-04 05:00:33,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c4c4cc5dc09b0c3a7517b6788625e266, server=jenkins-hbase20.apache.org,46127,1696395563481 in 212 msec 2023-10-04 05:00:33,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-04 05:00:33,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, ASSIGN in 374 msec 2023-10-04 05:00:33,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d22692621701486089b67ba203ab1969, ff3f822ede64e54b774bbc447946d8d0], force=true in 699 msec 2023-10-04 05:00:33,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 05:00:33,775 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-04 05:00:33,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 05:00:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395633777 (current time:1696395633777). 2023-10-04 05:00:33,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:33,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x331914c3 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:33,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9e7c29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:33,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:33,792 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:33,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x331914c3 to 127.0.0.1:60951 2023-10-04 05:00:33,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:33,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x714013fd to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:33,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a84ae1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:33,800 DEBUG [hconnection-0x6495e457-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:33,803 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:33,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:33,811 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:33,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x714013fd to 127.0.0.1:60951 2023-10-04 05:00:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 05:00:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:33,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 05:00:33,817 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:33,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 05:00:33,820 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 05:00:33,821 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696396233821 2023-10-04 05:00:33,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 05:00:33,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,825 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:33,825 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:33,826 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 05:00:33,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 05:00:33,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-10-04 05:00:33,828 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 05:00:33,829 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696396233829 2023-10-04 05:00:33,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,837 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 05:00:33,837 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:33,838 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-04 05:00:33,839 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-04 05:00:33,839 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,839 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,840 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,840 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,840 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,841 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 05:00:33,841 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 05:00:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,841 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 05:00:33,841 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:33,842 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:33,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 05:00:33,843 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 05:00:33,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 05:00:33,844 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:33,845 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 05:00:33,845 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 05:00:33,845 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 05:00:33,852 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,855 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,855 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:33,855 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:33,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-04 05:00:33,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70a87602[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:33,858 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-04 05:00:33,858 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 05:00:33,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,859 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 05:00:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:33,859 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:33,860 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. started... 2023-10-04 05:00:33,861 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4c4cc5dc09b0c3a7517b6788625e266: 2023-10-04 05:00:33,861 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 05:00:33,861 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,861 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:33,861 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:33,861 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 05:00:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 05:00:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:33,862 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/a36fe5c8fc9f4ac4bd1997092061c09d.ff3f822ede64e54b774bbc447946d8d0->hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d-top, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/aa065276a66a4864bb5ac4573096c6e7.d22692621701486089b67ba203ab1969->hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7-top] hfiles 2023-10-04 05:00:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 05:00:33,866 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/a36fe5c8fc9f4ac4bd1997092061c09d.ff3f822ede64e54b774bbc447946d8d0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,867 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/aa065276a66a4864bb5ac4573096c6e7.d22692621701486089b67ba203ab1969 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,876 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. completed. 2023-10-04 05:00:33,876 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:33,876 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:33,876 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:33,876 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,876 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 05:00:33,876 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:33,879 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,879 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 05:00:33,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:33,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:33,879 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:33,879 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 05:00:33,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:33,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:33,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:33,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:33,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-04 05:00:33,884 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-04 05:00:33,885 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:33,885 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:33,885 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,885 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:33,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,890 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,889 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,890 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,891 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:33,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,898 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,899 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:33,899 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,901 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:33,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,901 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:33,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:33,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:33,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-04 05:00:33,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,924 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696395633821Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696395633902 (+81 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696395633902Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696395633905 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696395633917 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696395633924 (+7 ms) 2023-10-04 05:00:33,925 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:33,926 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 05:00:33,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-04 05:00:33,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:33,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 101 msec 2023-10-04 05:00:33,927 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927 2023-10-04 05:00:33,927 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34757, tgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927, rawTgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:33,944 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:33,944 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-663014711_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,944 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-04 05:00:33,952 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:33,973 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,974 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,974 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,974 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:33,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,032 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-3446172605580655233.jar 2023-10-04 05:00:34,033 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,033 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,034 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,034 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,034 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,035 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:34,035 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 05:00:34,035 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 05:00:34,036 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 05:00:34,036 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 05:00:34,037 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 05:00:34,037 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 05:00:34,037 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 05:00:34,037 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 05:00:34,038 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 05:00:34,038 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 05:00:34,039 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:34,039 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:34,039 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:34,039 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:34,040 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:34,040 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:34,040 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:34,372 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 05:00:34,375 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-04 05:00:34,377 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-04 05:00:34,570 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:34,570 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:34,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0004_000001 (auth:SIMPLE) 2023-10-04 05:00:35,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0005_000001 (auth:SIMPLE) 2023-10-04 05:00:35,715 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 05:00:38,703 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0005_000001 (auth:SIMPLE) 2023-10-04 05:00:40,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0005_000001 (auth:SIMPLE) 2023-10-04 05:00:42,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0005_000001 (auth:SIMPLE) 2023-10-04 05:00:44,560 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:00:44,563 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:00:44,573 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,573 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:00:44,574 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:00:44,574 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,574 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 05:00:44,574 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 05:00:44,574 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,575 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 05:00:44,575 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395633927/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 05:00:44,583 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 05:00:44,587 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395644587"}]},"ts":"1696395644587"} 2023-10-04 05:00:44,589 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-04 05:00:44,590 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-04 05:00:44,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, UNASSIGN}] 2023-10-04 05:00:44,591 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, UNASSIGN 2023-10-04 05:00:44,592 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c4c4cc5dc09b0c3a7517b6788625e266, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:44,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696395644592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395644592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395644592"}]},"ts":"1696395644592"} 2023-10-04 05:00:44,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c4c4cc5dc09b0c3a7517b6788625e266, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:44,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 05:00:44,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:44,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c4c4cc5dc09b0c3a7517b6788625e266, disabling compactions & flushes 2023-10-04 05:00:44,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:44,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:44,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. after waiting 0 ms 2023-10-04 05:00:44,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:44,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-04 05:00:44,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:44,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266. 2023-10-04 05:00:44,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c4c4cc5dc09b0c3a7517b6788625e266: 2023-10-04 05:00:44,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:44,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c4c4cc5dc09b0c3a7517b6788625e266, regionState=CLOSED 2023-10-04 05:00:44,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696395644771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395644771"}]},"ts":"1696395644771"} 2023-10-04 05:00:44,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-04 05:00:44,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c4c4cc5dc09b0c3a7517b6788625e266, server=jenkins-hbase20.apache.org,46127,1696395563481 in 180 msec 2023-10-04 05:00:44,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-04 05:00:44,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4c4cc5dc09b0c3a7517b6788625e266, UNASSIGN in 184 msec 2023-10-04 05:00:44,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395644777"}]},"ts":"1696395644777"} 2023-10-04 05:00:44,778 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-04 05:00:44,779 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-04 05:00:44,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-10-04 05:00:44,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 05:00:44,893 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-04 05:00:44,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,904 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,906 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,906 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,906 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,906 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:44,906 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:44,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 05:00:44,907 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:44,907 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 05:00:44,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 05:00:44,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 05:00:44,907 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 05:00:44,907 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 05:00:44,907 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:44,907 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:44,907 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:44,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:44,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:44,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 05:00:44,909 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,909 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:44,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 05:00:44,910 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 05:00:44,910 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/recovered.edits] 2023-10-04 05:00:44,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:44,910 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/recovered.edits] 2023-10-04 05:00:44,910 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/recovered.edits] 2023-10-04 05:00:44,914 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/a36fe5c8fc9f4ac4bd1997092061c09d.ff3f822ede64e54b774bbc447946d8d0 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/a36fe5c8fc9f4ac4bd1997092061c09d.ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:44,914 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/cf/a36fe5c8fc9f4ac4bd1997092061c09d 2023-10-04 05:00:44,915 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/cf/aa065276a66a4864bb5ac4573096c6e7 2023-10-04 05:00:44,916 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/aa065276a66a4864bb5ac4573096c6e7.d22692621701486089b67ba203ab1969 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/cf/aa065276a66a4864bb5ac4573096c6e7.d22692621701486089b67ba203ab1969 2023-10-04 05:00:44,917 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/recovered.edits/8.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0/recovered.edits/8.seqid 2023-10-04 05:00:44,918 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff3f822ede64e54b774bbc447946d8d0 2023-10-04 05:00:44,918 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/recovered.edits/8.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969/recovered.edits/8.seqid 2023-10-04 05:00:44,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d22692621701486089b67ba203ab1969 2023-10-04 05:00:44,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/recovered.edits/12.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266/recovered.edits/12.seqid 2023-10-04 05:00:44,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4c4cc5dc09b0c3a7517b6788625e266 2023-10-04 05:00:44,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 05:00:44,921 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,923 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-04 05:00:44,925 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-04 05:00:44,926 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,926 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-04 05:00:44,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395644926"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:44,928 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-04 05:00:44,928 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c4c4cc5dc09b0c3a7517b6788625e266, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696395632012.c4c4cc5dc09b0c3a7517b6788625e266.', STARTKEY => '', ENDKEY => ''}] 2023-10-04 05:00:44,928 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-04 05:00:44,928 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395644928"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:44,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-04 05:00:44,933 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:44,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-10-04 05:00:45,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 05:00:45,011 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-04 05:00:45,012 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 05:00:45,020 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395645020"}]},"ts":"1696395645020"} 2023-10-04 05:00:45,021 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-04 05:00:45,022 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-04 05:00:45,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, UNASSIGN}] 2023-10-04 05:00:45,025 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, UNASSIGN 2023-10-04 05:00:45,025 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, UNASSIGN 2023-10-04 05:00:45,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca38d317994888a765c027d285c101c8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:45,026 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a2fc541ca3e5cd334c9e66ae65f955aa, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:45,026 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395645026"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395645026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395645026"}]},"ts":"1696395645026"} 2023-10-04 05:00:45,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395645026"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395645026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395645026"}]},"ts":"1696395645026"} 2023-10-04 05:00:45,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure a2fc541ca3e5cd334c9e66ae65f955aa, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:45,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure ca38d317994888a765c027d285c101c8, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:45,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 05:00:45,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:45,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ca38d317994888a765c027d285c101c8 2023-10-04 05:00:45,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a2fc541ca3e5cd334c9e66ae65f955aa, disabling compactions & flushes 2023-10-04 05:00:45,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:45,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:45,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. after waiting 0 ms 2023-10-04 05:00:45,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:45,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ca38d317994888a765c027d285c101c8, disabling compactions & flushes 2023-10-04 05:00:45,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:45,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:45,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. after waiting 0 ms 2023-10-04 05:00:45,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:45,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:45,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:45,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:45,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:45,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa. 2023-10-04 05:00:45,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8. 2023-10-04 05:00:45,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a2fc541ca3e5cd334c9e66ae65f955aa: 2023-10-04 05:00:45,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ca38d317994888a765c027d285c101c8: 2023-10-04 05:00:45,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ca38d317994888a765c027d285c101c8 2023-10-04 05:00:45,204 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca38d317994888a765c027d285c101c8, regionState=CLOSED 2023-10-04 05:00:45,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:45,204 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395645204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395645204"}]},"ts":"1696395645204"} 2023-10-04 05:00:45,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a2fc541ca3e5cd334c9e66ae65f955aa, regionState=CLOSED 2023-10-04 05:00:45,205 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696395645205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395645205"}]},"ts":"1696395645205"} 2023-10-04 05:00:45,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-10-04 05:00:45,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure ca38d317994888a765c027d285c101c8, server=jenkins-hbase20.apache.org,35697,1696395563431 in 176 msec 2023-10-04 05:00:45,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-10-04 05:00:45,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure a2fc541ca3e5cd334c9e66ae65f955aa, server=jenkins-hbase20.apache.org,46127,1696395563481 in 178 msec 2023-10-04 05:00:45,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca38d317994888a765c027d285c101c8, UNASSIGN in 184 msec 2023-10-04 05:00:45,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-04 05:00:45,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2fc541ca3e5cd334c9e66ae65f955aa, UNASSIGN in 184 msec 2023-10-04 05:00:45,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395645208"}]},"ts":"1696395645208"} 2023-10-04 05:00:45,209 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-04 05:00:45,210 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-04 05:00:45,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-10-04 05:00:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 05:00:45,324 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-04 05:00:45,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,332 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,334 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,335 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,337 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,337 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,337 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,337 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 05:00:45,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-04 05:00:45,338 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 05:00:45,339 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 05:00:45,340 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:45,340 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:45,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 05:00:45,343 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/recovered.edits] 2023-10-04 05:00:45,343 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/recovered.edits] 2023-10-04 05:00:45,346 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/cf/5fef2d89a55449619ffd5f03c832986b 2023-10-04 05:00:45,347 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/cf/0be8fdb0421a4c22a2438ccfd71a2efb 2023-10-04 05:00:45,349 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa/recovered.edits/9.seqid 2023-10-04 05:00:45,349 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8/recovered.edits/9.seqid 2023-10-04 05:00:45,350 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2fc541ca3e5cd334c9e66ae65f955aa 2023-10-04 05:00:45,350 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca38d317994888a765c027d285c101c8 2023-10-04 05:00:45,350 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 05:00:45,350 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 05:00:45,351 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-04 05:00:45,354 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100465b7867c61be460282822b18ec47ab77 2023-10-04 05:00:45,355 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004ca2c4bf375c741f0813990d646b11a4d 2023-10-04 05:00:45,355 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 05:00:45,358 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,360 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-04 05:00:45,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-04 05:00:45,362 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,362 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-04 05:00:45,363 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395645363"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:45,363 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395645363"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:45,364 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 05:00:45,364 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca38d317994888a765c027d285c101c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696395630611.ca38d317994888a765c027d285c101c8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a2fc541ca3e5cd334c9e66ae65f955aa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696395630611.a2fc541ca3e5cd334c9e66ae65f955aa.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 05:00:45,364 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-04 05:00:45,365 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395645364"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:45,366 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-04 05:00:45,367 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 41 msec 2023-10-04 05:00:45,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 05:00:45,444 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-04 05:00:45,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 05:00:45,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 05:00:45,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 05:00:45,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-04 05:00:45,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 05:00:45,493 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 759) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4069 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:56944 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:59222 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:55418 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:39647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1056332411_1 at /127.0.0.1:55384 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:55416 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 229), ProcessCount=166 (was 166), AvailableMemoryMB=1011 (was 1035) 2023-10-04 05:00:45,493 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 05:00:45,511 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=166, AvailableMemoryMB=1010 2023-10-04 05:00:45,511 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 05:00:45,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 05:00:45,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:45,515 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 05:00:45,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-04 05:00:45,516 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 05:00:45,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 05:00:45,518 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,518 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,519 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f empty. 2023-10-04 05:00:45,519 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a empty. 2023-10-04 05:00:45,519 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,519 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,519 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 05:00:45,530 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 05:00:45,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => aeb6497ac27714b380cb393fe956ca2f, NAME => 'testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:45,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7757768e49c18af9fb4280b276d6a16a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing aeb6497ac27714b380cb393fe956ca2f, disabling compactions & flushes 2023-10-04 05:00:45,557 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. after waiting 0 ms 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7757768e49c18af9fb4280b276d6a16a, disabling compactions & flushes 2023-10-04 05:00:45,557 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for aeb6497ac27714b380cb393fe956ca2f: 2023-10-04 05:00:45,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. after waiting 0 ms 2023-10-04 05:00:45,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,558 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7757768e49c18af9fb4280b276d6a16a: 2023-10-04 05:00:45,561 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 05:00:45,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395645562"}]},"ts":"1696395645562"} 2023-10-04 05:00:45,563 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395645562"}]},"ts":"1696395645562"} 2023-10-04 05:00:45,564 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 05:00:45,565 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 05:00:45,565 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395645565"}]},"ts":"1696395645565"} 2023-10-04 05:00:45,567 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 05:00:45,569 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 05:00:45,571 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 05:00:45,571 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 05:00:45,571 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 05:00:45,571 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 05:00:45,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, ASSIGN}] 2023-10-04 05:00:45,574 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, ASSIGN 2023-10-04 05:00:45,574 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, ASSIGN 2023-10-04 05:00:45,575 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 05:00:45,575 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41937,1696395563528; forceNewPlan=false, retain=false 2023-10-04 05:00:45,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 05:00:45,725 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 05:00:45,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7757768e49c18af9fb4280b276d6a16a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:45,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=aeb6497ac27714b380cb393fe956ca2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:45,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395645731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395645731"}]},"ts":"1696395645731"} 2023-10-04 05:00:45,732 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395645731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395645731"}]},"ts":"1696395645731"} 2023-10-04 05:00:45,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 7757768e49c18af9fb4280b276d6a16a, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:45,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure aeb6497ac27714b380cb393fe956ca2f, server=jenkins-hbase20.apache.org,41937,1696395563528}] 2023-10-04 05:00:45,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 05:00:45,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7757768e49c18af9fb4280b276d6a16a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 05:00:45,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aeb6497ac27714b380cb393fe956ca2f, NAME => 'testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. service=AccessControlService 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. service=AccessControlService 2023-10-04 05:00:45,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:45,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,902 INFO [StoreOpener-7757768e49c18af9fb4280b276d6a16a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,902 INFO [StoreOpener-aeb6497ac27714b380cb393fe956ca2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,903 DEBUG [StoreOpener-7757768e49c18af9fb4280b276d6a16a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf 2023-10-04 05:00:45,903 DEBUG [StoreOpener-aeb6497ac27714b380cb393fe956ca2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf 2023-10-04 05:00:45,903 DEBUG [StoreOpener-7757768e49c18af9fb4280b276d6a16a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf 2023-10-04 05:00:45,903 DEBUG [StoreOpener-aeb6497ac27714b380cb393fe956ca2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf 2023-10-04 05:00:45,904 INFO [StoreOpener-aeb6497ac27714b380cb393fe956ca2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aeb6497ac27714b380cb393fe956ca2f columnFamilyName cf 2023-10-04 05:00:45,904 INFO [StoreOpener-7757768e49c18af9fb4280b276d6a16a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7757768e49c18af9fb4280b276d6a16a columnFamilyName cf 2023-10-04 05:00:45,905 INFO [StoreOpener-aeb6497ac27714b380cb393fe956ca2f-1] regionserver.HStore(310): Store=aeb6497ac27714b380cb393fe956ca2f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:45,905 INFO [StoreOpener-7757768e49c18af9fb4280b276d6a16a-1] regionserver.HStore(310): Store=7757768e49c18af9fb4280b276d6a16a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:45,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:45,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:45,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:45,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7757768e49c18af9fb4280b276d6a16a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67567098, jitterRate=0.006828218698501587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:45,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7757768e49c18af9fb4280b276d6a16a: 2023-10-04 05:00:45,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aeb6497ac27714b380cb393fe956ca2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58992015, jitterRate=-0.12095047533512115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:45,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aeb6497ac27714b380cb393fe956ca2f: 2023-10-04 05:00:45,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a., pid=93, masterSystemTime=1696395645885 2023-10-04 05:00:45,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f., pid=94, masterSystemTime=1696395645885 2023-10-04 05:00:45,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:45,920 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=aeb6497ac27714b380cb393fe956ca2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:45,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:45,920 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645920"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395645920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395645920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395645920"}]},"ts":"1696395645920"} 2023-10-04 05:00:45,921 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7757768e49c18af9fb4280b276d6a16a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:45,921 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395645921"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395645921"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395645921"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395645921"}]},"ts":"1696395645921"} 2023-10-04 05:00:45,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-04 05:00:45,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure aeb6497ac27714b380cb393fe956ca2f, server=jenkins-hbase20.apache.org,41937,1696395563528 in 187 msec 2023-10-04 05:00:45,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-04 05:00:45,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 7757768e49c18af9fb4280b276d6a16a, server=jenkins-hbase20.apache.org,46127,1696395563481 in 188 msec 2023-10-04 05:00:45,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, ASSIGN in 352 msec 2023-10-04 05:00:45,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-04 05:00:45,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, ASSIGN in 352 msec 2023-10-04 05:00:45,925 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 05:00:45,925 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395645925"}]},"ts":"1696395645925"} 2023-10-04 05:00:45,926 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 05:00:45,927 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 05:00:45,928 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-04 05:00:45,929 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 05:00:45,930 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,930 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,930 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,930 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:45,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:45,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:45,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:45,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:45,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 417 msec 2023-10-04 05:00:46,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 05:00:46,123 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-04 05:00:46,125 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,126 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,128 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:46,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395646145 (current time:1696395646145). 2023-10-04 05:00:46,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:46,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x3a9b1417 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:46,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103a8768, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:46,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,159 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a9b1417 to 127.0.0.1:60951 2023-10-04 05:00:46,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:46,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x5fe16751 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:46,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3db8eb16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:46,168 DEBUG [hconnection-0x79fd3a0e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,172 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,181 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fe16751 to 127.0.0.1:60951 2023-10-04 05:00:46,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:46,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 05:00:46,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:46,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,186 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:46,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,192 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,193 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696396246193 2023-10-04 05:00:46,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,195 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:46,195 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:46,196 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-04 05:00:46,201 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,201 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696396246201 2023-10-04 05:00:46,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,216 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-04 05:00:46,216 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,217 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 05:00:46,217 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 05:00:46,218 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,218 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,220 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,220 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,220 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,220 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,221 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 05:00:46,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,224 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,224 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,229 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,230 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,229 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,229 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,231 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,232 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,232 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,232 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,235 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,235 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,235 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a595f75[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 05:00:46,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a595f75[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:46,239 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 05:00:46,239 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,239 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,240 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,240 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:46,240 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:46,240 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. started... 2023-10-04 05:00:46,240 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:46,240 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:46,240 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. started... 2023-10-04 05:00:46,240 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aeb6497ac27714b380cb393fe956ca2f: 2023-10-04 05:00:46,241 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7757768e49c18af9fb4280b276d6a16a: 2023-10-04 05:00:46,241 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,241 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:46,242 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,242 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:46,242 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:46,242 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:46,242 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,242 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,242 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,251 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. completed. 2023-10-04 05:00:46,251 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:46,251 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:46,251 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:46,251 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,251 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,251 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:46,252 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. completed. 2023-10-04 05:00:46,252 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,252 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:46,252 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:46,252 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,252 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,252 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:46,259 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,260 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,260 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,260 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,272 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,272 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,272 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,272 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 05:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,41937,1696395563528': 2023-10-04 05:00:46,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 05:00:46,287 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 05:00:46,288 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:46,288 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:46,288 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,288 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,291 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,290 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,291 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,292 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,292 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,295 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:46,295 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,295 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 05:00:46,296 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:46,296 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:46,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,301 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,301 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,302 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,304 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:46,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,304 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,304 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,305 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,305 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,305 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,305 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 05:00:46,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 05:00:46,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,336 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696395646193Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696395646313 (+120 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696395646313Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696395646313Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696395646317 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696395646329 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696395646335 (+6 ms) 2023-10-04 05:00:46,340 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 146 msec 2023-10-04 05:00:46,497 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:46,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 05:00:46,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:46,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41937] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:46,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:46,512 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,512 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,512 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:46,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395646522 (current time:1696395646522). 2023-10-04 05:00:46,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:46,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x76b25d66 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:46,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d082c4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:46,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,532 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76b25d66 to 127.0.0.1:60951 2023-10-04 05:00:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:46,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x4674e8d7 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2249c412, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:46,542 DEBUG [hconnection-0x5e5fc66d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,543 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:46,549 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4674e8d7 to 127.0.0.1:60951 2023-10-04 05:00:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 05:00:46,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:46,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,553 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,556 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,557 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696396246557 2023-10-04 05:00:46,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 05:00:46,558 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:46,558 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:46,559 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 05:00:46,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-04 05:00:46,561 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,562 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696396246562 2023-10-04 05:00:46,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,570 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-04 05:00:46,570 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,571 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 05:00:46,571 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 05:00:46,572 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,572 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,572 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,572 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,572 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,572 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,573 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,573 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 05:00:46,574 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,574 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,577 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,575 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:46,577 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,581 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,581 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,581 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 05:00:46,581 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 05:00:46,581 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 05:00:46,584 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,586 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,586 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22cfd749[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 05:00:46,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22cfd749[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:46,590 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 05:00:46,590 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,597 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,597 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,597 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:46,597 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,597 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 05:00:46,597 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,598 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:46,598 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:46,598 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:46,598 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:46,598 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,598 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:46,598 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:46,598 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. started... 2023-10-04 05:00:46,598 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. started... 2023-10-04 05:00:46,598 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aeb6497ac27714b380cb393fe956ca2f 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 05:00:46,598 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7757768e49c18af9fb4280b276d6a16a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 05:00:46,601 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,602 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,602 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,618 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6 2023-10-04 05:00:46,618 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691 2023-10-04 05:00:46,625 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/.tmp/cf/a92d016378654e94bccde39ca750f444 2023-10-04 05:00:46,626 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/.tmp/cf/c166079a11ec4368be901be12670abae 2023-10-04 05:00:46,631 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/.tmp/cf/a92d016378654e94bccde39ca750f444 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444 2023-10-04 05:00:46,631 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/.tmp/cf/c166079a11ec4368be901be12670abae as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae 2023-10-04 05:00:46,635 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae, entries=45, sequenceid=6, filesize=12.7 K 2023-10-04 05:00:46,635 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444, entries=5, sequenceid=6, filesize=5.8 K 2023-10-04 05:00:46,636 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7757768e49c18af9fb4280b276d6a16a in 38ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:46,636 INFO [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for aeb6497ac27714b380cb393fe956ca2f in 38ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:46,636 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 05:00:46,636 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 05:00:46,638 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aeb6497ac27714b380cb393fe956ca2f: 2023-10-04 05:00:46,638 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7757768e49c18af9fb4280b276d6a16a: 2023-10-04 05:00:46,639 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,639 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444] hfiles 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae] hfiles 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,640 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,650 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. completed. 2023-10-04 05:00:46,650 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:46,650 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. completed. 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:46,650 DEBUG [rs(jenkins-hbase20.apache.org,41937,1696395563528)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:46,650 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:46,651 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,651 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,651 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 05:00:46,651 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,651 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,652 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,652 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,653 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 05:00:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,659 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 05:00:46,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,660 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,41937,1696395563528': 2023-10-04 05:00:46,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 05:00:46,661 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 05:00:46,661 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:46,661 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:46,661 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,661 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,669 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,668 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,669 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,670 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:46,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,673 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:46,673 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,674 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:46,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,678 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,678 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:46,680 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:46,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:46,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:46,680 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:46,680 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:46,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:46,681 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:46,681 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,681 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691] mob files 2023-10-04 05:00:46,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6 2023-10-04 05:00:46,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691 2023-10-04 05:00:46,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,714 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 05:00:46,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696395646557Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696395646689 (+132 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696395646689Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696395646689Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696395646693 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696395646704 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696395646714 (+10 ms) 2023-10-04 05:00:46,720 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 05:00:46,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 162 msec 2023-10-04 05:00:46,860 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:46,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 05:00:46,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:46,864 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864 2023-10-04 05:00:46,865 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34757, tgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864, rawTgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:46,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:46,889 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-68062963_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,889 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-04 05:00:46,894 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:46,914 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,915 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,915 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,916 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,916 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,916 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,917 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,974 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-8792970075230859699.jar 2023-10-04 05:00:46,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,975 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,976 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,976 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:46,976 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 05:00:46,976 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 05:00:46,977 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 05:00:46,977 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 05:00:46,977 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 05:00:46,978 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 05:00:46,978 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 05:00:46,978 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 05:00:46,978 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 05:00:46,979 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 05:00:46,979 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:46,979 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:46,980 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:46,980 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:46,980 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:46,980 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:46,981 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:47,321 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 05:00:47,324 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-04 05:00:49,161 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:49,162 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:00:49,163 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0005_000001 (auth:SIMPLE) 2023-10-04 05:00:49,592 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0006_000001 (auth:SIMPLE) 2023-10-04 05:00:50,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 05:00:52,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0006_000001 (auth:SIMPLE) 2023-10-04 05:00:55,711 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:00:55,712 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:00:55,716 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:55,717 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:00:55,717 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:00:55,717 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:55,718 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 05:00:55,718 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 05:00:55,718 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:55,718 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 05:00:55,718 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395646864/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 05:00:55,724 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-04 05:00:55,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-10-04 05:00:55,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 05:00:55,728 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395655728"}]},"ts":"1696395655728"} 2023-10-04 05:00:55,729 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 05:00:55,730 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-04 05:00:55,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, UNASSIGN}] 2023-10-04 05:00:55,733 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, UNASSIGN 2023-10-04 05:00:55,733 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, UNASSIGN 2023-10-04 05:00:55,734 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=aeb6497ac27714b380cb393fe956ca2f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:55,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7757768e49c18af9fb4280b276d6a16a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:55,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395655734"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395655734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395655734"}]},"ts":"1696395655734"} 2023-10-04 05:00:55,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395655734"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395655734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395655734"}]},"ts":"1696395655734"} 2023-10-04 05:00:55,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure aeb6497ac27714b380cb393fe956ca2f, server=jenkins-hbase20.apache.org,41937,1696395563528}] 2023-10-04 05:00:55,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 7757768e49c18af9fb4280b276d6a16a, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:55,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 05:00:55,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:55,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7757768e49c18af9fb4280b276d6a16a, disabling compactions & flushes 2023-10-04 05:00:55,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aeb6497ac27714b380cb393fe956ca2f, disabling compactions & flushes 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. after waiting 0 ms 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:55,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. after waiting 0 ms 2023-10-04 05:00:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:55,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:55,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:00:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:00:55,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a. 2023-10-04 05:00:55,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f. 2023-10-04 05:00:55,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7757768e49c18af9fb4280b276d6a16a: 2023-10-04 05:00:55,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aeb6497ac27714b380cb393fe956ca2f: 2023-10-04 05:00:55,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:55,900 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=aeb6497ac27714b380cb393fe956ca2f, regionState=CLOSED 2023-10-04 05:00:55,900 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395655900"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395655900"}]},"ts":"1696395655900"} 2023-10-04 05:00:55,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:55,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7757768e49c18af9fb4280b276d6a16a, regionState=CLOSED 2023-10-04 05:00:55,901 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696395655900"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395655900"}]},"ts":"1696395655900"} 2023-10-04 05:00:55,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-04 05:00:55,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure aeb6497ac27714b380cb393fe956ca2f, server=jenkins-hbase20.apache.org,41937,1696395563528 in 166 msec 2023-10-04 05:00:55,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-04 05:00:55,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 7757768e49c18af9fb4280b276d6a16a, server=jenkins-hbase20.apache.org,46127,1696395563481 in 166 msec 2023-10-04 05:00:55,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=aeb6497ac27714b380cb393fe956ca2f, UNASSIGN in 172 msec 2023-10-04 05:00:55,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-04 05:00:55,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7757768e49c18af9fb4280b276d6a16a, UNASSIGN in 172 msec 2023-10-04 05:00:55,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395655904"}]},"ts":"1696395655904"} 2023-10-04 05:00:55,905 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 05:00:55,906 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-04 05:00:55,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 182 msec 2023-10-04 05:00:56,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 05:00:56,032 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-04 05:00:56,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,042 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,043 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,045 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,045 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,045 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,045 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 05:00:56,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 05:00:56,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 05:00:56,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,046 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,047 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:56,047 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:56,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 05:00:56,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/recovered.edits] 2023-10-04 05:00:56,049 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/recovered.edits] 2023-10-04 05:00:56,052 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/cf/c166079a11ec4368be901be12670abae 2023-10-04 05:00:56,052 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/cf/a92d016378654e94bccde39ca750f444 2023-10-04 05:00:56,055 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a/recovered.edits/9.seqid 2023-10-04 05:00:56,055 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f/recovered.edits/9.seqid 2023-10-04 05:00:56,055 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7757768e49c18af9fb4280b276d6a16a 2023-10-04 05:00:56,055 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testEmptyExportFileSystemState/aeb6497ac27714b380cb393fe956ca2f 2023-10-04 05:00:56,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 05:00:56,055 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 05:00:56,056 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-04 05:00:56,059 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310043aceceaf359342f4ad318fb063e0baa6 2023-10-04 05:00:56,060 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310048181ca51314e40df8d5ff7ee775d5691 2023-10-04 05:00:56,060 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 05:00:56,062 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,064 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-04 05:00:56,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-04 05:00:56,066 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,066 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-04 05:00:56,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395656067"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:56,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395656067"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:56,068 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 05:00:56,068 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aeb6497ac27714b380cb393fe956ca2f, NAME => 'testtb-testEmptyExportFileSystemState,,1696395645512.aeb6497ac27714b380cb393fe956ca2f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7757768e49c18af9fb4280b276d6a16a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696395645512.7757768e49c18af9fb4280b276d6a16a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 05:00:56,068 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-04 05:00:56,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395656068"}]},"ts":"9223372036854775807"} 2023-10-04 05:00:56,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-04 05:00:56,077 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 05:00:56,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 43 msec 2023-10-04 05:00:56,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 05:00:56,149 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-04 05:00:56,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-04 05:00:56,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:56,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-04 05:00:56,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-04 05:00:56,184 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1607544320_1 at /127.0.0.1:55904 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:45281 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:35902 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:34865 from appattempt_1696395569426_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (215173477) connection to jenkins-hbase20.apache.org/148.251.75.209:42063 from appattempt_1696395569426_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1947213829_17 at /127.0.0.1:48572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4723 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1607544320_1 at /127.0.0.1:48548 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5165e80f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1092093499_17 at /127.0.0.1:53886 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=960 (was 928) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=940 (was 1010) 2023-10-04 05:00:56,184 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-04 05:00:56,200 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=960, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=166, AvailableMemoryMB=940 2023-10-04 05:00:56,200 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-04 05:00:56,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 05:00:56,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 05:00:56,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-04 05:00:56,206 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 05:00:56,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 05:00:56,208 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,208 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,209 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 empty. 2023-10-04 05:00:56,209 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c empty. 2023-10-04 05:00:56,209 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,209 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 05:00:56,222 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-04 05:00:56,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a18ccd2c36b8c3eaa440fbdad11026c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:56,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc0a9f080c6b91e51692c5a373490a42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing cc0a9f080c6b91e51692c5a373490a42, disabling compactions & flushes 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:56,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 8a18ccd2c36b8c3eaa440fbdad11026c, disabling compactions & flushes 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. after waiting 0 ms 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. after waiting 0 ms 2023-10-04 05:00:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for cc0a9f080c6b91e51692c5a373490a42: 2023-10-04 05:00:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,242 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 8a18ccd2c36b8c3eaa440fbdad11026c: 2023-10-04 05:00:56,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 05:00:56,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395656244"}]},"ts":"1696395656244"} 2023-10-04 05:00:56,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395656244"}]},"ts":"1696395656244"} 2023-10-04 05:00:56,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 05:00:56,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 05:00:56,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395656247"}]},"ts":"1696395656247"} 2023-10-04 05:00:56,248 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-04 05:00:56,250 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-04 05:00:56,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 05:00:56,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 05:00:56,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 05:00:56,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 05:00:56,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, ASSIGN}] 2023-10-04 05:00:56,254 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, ASSIGN 2023-10-04 05:00:56,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, ASSIGN 2023-10-04 05:00:56,254 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35697,1696395563431; forceNewPlan=false, retain=false 2023-10-04 05:00:56,254 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46127,1696395563481; forceNewPlan=false, retain=false 2023-10-04 05:00:56,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 05:00:56,405 INFO [jenkins-hbase20:38813] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 05:00:56,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8a18ccd2c36b8c3eaa440fbdad11026c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cc0a9f080c6b91e51692c5a373490a42, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,407 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656407"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395656407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395656407"}]},"ts":"1696395656407"} 2023-10-04 05:00:56,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656407"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395656407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395656407"}]},"ts":"1696395656407"} 2023-10-04 05:00:56,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 8a18ccd2c36b8c3eaa440fbdad11026c, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:00:56,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure cc0a9f080c6b91e51692c5a373490a42, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:00:56,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 05:00:56,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a18ccd2c36b8c3eaa440fbdad11026c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 05:00:56,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. service=AccessControlService 2023-10-04 05:00:56,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc0a9f080c6b91e51692c5a373490a42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 05:00:56,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. service=AccessControlService 2023-10-04 05:00:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 05:00:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 05:00:56,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,572 INFO [StoreOpener-8a18ccd2c36b8c3eaa440fbdad11026c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,573 INFO [StoreOpener-cc0a9f080c6b91e51692c5a373490a42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,574 DEBUG [StoreOpener-8a18ccd2c36b8c3eaa440fbdad11026c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf 2023-10-04 05:00:56,574 DEBUG [StoreOpener-8a18ccd2c36b8c3eaa440fbdad11026c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf 2023-10-04 05:00:56,574 DEBUG [StoreOpener-cc0a9f080c6b91e51692c5a373490a42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf 2023-10-04 05:00:56,574 DEBUG [StoreOpener-cc0a9f080c6b91e51692c5a373490a42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf 2023-10-04 05:00:56,575 INFO [StoreOpener-8a18ccd2c36b8c3eaa440fbdad11026c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a18ccd2c36b8c3eaa440fbdad11026c columnFamilyName cf 2023-10-04 05:00:56,575 INFO [StoreOpener-cc0a9f080c6b91e51692c5a373490a42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc0a9f080c6b91e51692c5a373490a42 columnFamilyName cf 2023-10-04 05:00:56,576 INFO [StoreOpener-8a18ccd2c36b8c3eaa440fbdad11026c-1] regionserver.HStore(310): Store=8a18ccd2c36b8c3eaa440fbdad11026c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:56,576 INFO [StoreOpener-cc0a9f080c6b91e51692c5a373490a42-1] regionserver.HStore(310): Store=cc0a9f080c6b91e51692c5a373490a42/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 05:00:56,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:00:56,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:00:56,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:56,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 05:00:56,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8a18ccd2c36b8c3eaa440fbdad11026c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74924385, jitterRate=0.11646033823490143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:56,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cc0a9f080c6b91e51692c5a373490a42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60962421, jitterRate=-0.09158913791179657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 05:00:56,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8a18ccd2c36b8c3eaa440fbdad11026c: 2023-10-04 05:00:56,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cc0a9f080c6b91e51692c5a373490a42: 2023-10-04 05:00:56,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c., pid=108, masterSystemTime=1696395656560 2023-10-04 05:00:56,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42., pid=109, masterSystemTime=1696395656562 2023-10-04 05:00:56,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,584 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8a18ccd2c36b8c3eaa440fbdad11026c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,584 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656583"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395656583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395656583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395656583"}]},"ts":"1696395656583"} 2023-10-04 05:00:56,584 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cc0a9f080c6b91e51692c5a373490a42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,584 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395656584"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696395656584"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696395656584"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696395656584"}]},"ts":"1696395656584"} 2023-10-04 05:00:56,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-04 05:00:56,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 8a18ccd2c36b8c3eaa440fbdad11026c, server=jenkins-hbase20.apache.org,35697,1696395563431 in 176 msec 2023-10-04 05:00:56,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-04 05:00:56,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure cc0a9f080c6b91e51692c5a373490a42, server=jenkins-hbase20.apache.org,46127,1696395563481 in 177 msec 2023-10-04 05:00:56,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, ASSIGN in 336 msec 2023-10-04 05:00:56,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-04 05:00:56,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, ASSIGN in 336 msec 2023-10-04 05:00:56,589 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 05:00:56,589 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395656589"}]},"ts":"1696395656589"} 2023-10-04 05:00:56,590 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-04 05:00:56,591 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 05:00:56,591 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-04 05:00:56,593 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 05:00:56,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,594 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:00:56,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:56,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:56,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:56,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 05:00:56,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 392 msec 2023-10-04 05:00:56,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 05:00:56,813 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-04 05:00:56,819 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,819 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,823 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:56,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395656839 (current time:1696395656839). 2023-10-04 05:00:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:56,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x2b123cac to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:56,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a1d90d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:56,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:56,848 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:56,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b123cac to 127.0.0.1:60951 2023-10-04 05:00:56,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:56,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x4fbbf588 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:56,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75f6578f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:56,865 DEBUG [hconnection-0x3953918d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:56,868 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:56,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:56,875 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:56,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fbbf588 to 127.0.0.1:60951 2023-10-04 05:00:56,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:56,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 05:00:56,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:56,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:56,880 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:56,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:56,883 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:56,883 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696396256883 2023-10-04 05:00:56,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:56,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,885 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:56,885 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:56,887 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:56,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:56,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-04 05:00:56,889 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:56,889 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696396256889 2023-10-04 05:00:56,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,898 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 05:00:56,898 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:56,900 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 05:00:56,900 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 05:00:56,900 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,900 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,902 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,902 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,902 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:56,903 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:56,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,903 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:56,903 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:56,905 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:56,903 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:56,906 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:56,907 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:56,907 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:56,913 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,913 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:56,913 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,913 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,913 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:56,913 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,913 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:56,914 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,914 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:56,914 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,914 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e572b1[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:56,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 05:00:56,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e572b1[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:56,917 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 05:00:56,917 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,921 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,921 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,921 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,922 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,922 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:56,922 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:56,922 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. started... 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:56,923 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,922 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:56,923 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. started... 2023-10-04 05:00:56,923 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a18ccd2c36b8c3eaa440fbdad11026c: 2023-10-04 05:00:56,923 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0a9f080c6b91e51692c5a373490a42: 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:56,924 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 05:00:56,925 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:56,925 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:56,925 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:56,942 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. completed. 2023-10-04 05:00:56,942 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:56,942 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:56,942 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:56,942 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,942 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:56,943 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:56,944 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:56,944 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,944 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:56,944 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:56,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,948 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. completed. 2023-10-04 05:00:56,948 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,949 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,949 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,949 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:56,949 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:56,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:56,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:56,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 05:00:56,954 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 05:00:56,954 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:56,954 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:56,954 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,954 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,963 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:56,964 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,964 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,964 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:56,966 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,966 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,966 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:56,972 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,972 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:56,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,972 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:56,971 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,973 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:56,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,974 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 05:00:56,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,985 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 05:00:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:56,987 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:56,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:56,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 05:00:56,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696395656884Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696395656984 (+100 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696395656984Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696395656985 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696395656988 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696395656994 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696395656999 (+5 ms) 2023-10-04 05:00:57,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:57,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 118 msec 2023-10-04 05:00:57,187 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 05:00:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:57,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:57,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46127] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 05:00:57,200 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,201 DEBUG [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:57,201 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 05:00:57,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:57,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696395657210 (current time:1696395657210). 2023-10-04 05:00:57,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 05:00:57,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x3ebfc502 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:57,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fb2c41a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:57,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:57,220 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:57,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ebfc502 to 127.0.0.1:60951 2023-10-04 05:00:57,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:57,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(139): Connect 0x4bb83fb2 to 127.0.0.1:60951 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 05:00:57,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b6f7412, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 05:00:57,228 DEBUG [hconnection-0x2254f371-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:57,236 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:57,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 05:00:57,244 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 05:00:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bb83fb2 to 127.0.0.1:60951 2023-10-04 05:00:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:00:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 05:00:57,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 05:00:57,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:57,250 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot, current working dir path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 05:00:57,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:57,253 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:57,254 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696396257254 2023-10-04 05:00:57,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 05:00:57,256 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 05:00:57,256 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 05:00:57,257 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 05:00:57,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:57,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-04 05:00:57,259 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:57,259 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696396257259 2023-10-04 05:00:57,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,270 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 05:00:57,270 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:57,271 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 05:00:57,271 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 05:00:57,272 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,272 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,272 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,272 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,272 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,272 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,273 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,273 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,274 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:57,274 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,274 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:57,274 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:57,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 05:00:57,275 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:57,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 05:00:57,277 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 05:00:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:57,278 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 05:00:57,278 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 05:00:57,278 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41937,1696395563528' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 05:00:57,279 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,279 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:57,280 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,280 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,280 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:57,280 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,280 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:57,281 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,281 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:57,281 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:57,281 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 05:00:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35697,1696395563431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@264e0e69[Count = 1] remaining members to acquire global barrier 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:57,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46127,1696395563481' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 05:00:57,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@264e0e69[Count = 0] remaining members to acquire global barrier 2023-10-04 05:00:57,284 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 05:00:57,284 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,292 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,292 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,292 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:57,293 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,293 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 05:00:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,293 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:57,293 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. started... 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,41937,1696395563528' in zk 2023-10-04 05:00:57,293 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 05:00:57,294 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 05:00:57,294 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc0a9f080c6b91e51692c5a373490a42 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 05:00:57,294 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:57,294 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. started... 2023-10-04 05:00:57,294 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a18ccd2c36b8c3eaa440fbdad11026c 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 05:00:57,297 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:57,297 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:57,297 DEBUG [member: 'jenkins-hbase20.apache.org,41937,1696395563528' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:57,313 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c 2023-10-04 05:00:57,313 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4 2023-10-04 05:00:57,321 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/.tmp/cf/a68b02cb83454959bc0b6284ab2fc36a 2023-10-04 05:00:57,321 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/.tmp/cf/cc4bc3f9b8954873a3d2c09fc1c51592 2023-10-04 05:00:57,328 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/.tmp/cf/cc4bc3f9b8954873a3d2c09fc1c51592 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592 2023-10-04 05:00:57,328 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/.tmp/cf/a68b02cb83454959bc0b6284ab2fc36a as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a 2023-10-04 05:00:57,333 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a, entries=5, sequenceid=6, filesize=5.8 K 2023-10-04 05:00:57,333 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592, entries=45, sequenceid=6, filesize=13.0 K 2023-10-04 05:00:57,334 INFO [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8a18ccd2c36b8c3eaa440fbdad11026c in 40ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:57,334 INFO [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for cc0a9f080c6b91e51692c5a373490a42 in 41ms, sequenceid=6, compaction requested=false 2023-10-04 05:00:57,334 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 05:00:57,334 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a18ccd2c36b8c3eaa440fbdad11026c: 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0a9f080c6b91e51692c5a373490a42: 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a] hfiles 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592] hfiles 2023-10-04 05:00:57,337 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,351 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. completed. 2023-10-04 05:00:57,351 DEBUG [rs(jenkins-hbase20.apache.org,35697,1696395563431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:57,351 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. completed. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,351 DEBUG [rs(jenkins-hbase20.apache.org,46127,1696395563481)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 05:00:57,351 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,35697,1696395563431' in zk 2023-10-04 05:00:57,352 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,352 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 05:00:57,352 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,46127,1696395563481' in zk 2023-10-04 05:00:57,353 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,353 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:57,353 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:57,353 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 05:00:57,353 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:57,353 DEBUG [member: 'jenkins-hbase20.apache.org,35697,1696395563431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:57,353 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,355 DEBUG [member: 'jenkins-hbase20.apache.org,46127,1696395563481' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 05:00:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:57,356 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 05:00:57,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 05:00:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,357 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 05:00:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,35697,1696395563431': 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35697,1696395563431' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,46127,1696395563481': 2023-10-04 05:00:57,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46127,1696395563481' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 05:00:57,363 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 05:00:57,363 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 05:00:57,363 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 05:00:57,363 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,364 INFO [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 05:00:57,368 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 05:00:57,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,369 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,370 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 05:00:57,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,372 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 05:00:57,372 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,373 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 05:00:57,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 05:00:57,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,380 DEBUG [(jenkins-hbase20.apache.org,38813,1696395562368)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 05:00:57,380 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 05:00:57,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 05:00:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 05:00:57,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,381 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,383 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,383 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,383 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:00:57,384 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,384 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:00:57,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c] mob files 2023-10-04 05:00:57,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 05:00:57,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4 2023-10-04 05:00:57,384 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:00:57,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c 2023-10-04 05:00:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 05:00:57,385 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,385 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 05:00:57,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,413 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696395657254Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696395657393 (+139 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696395657393Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696395657393Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696395657396 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696395657405 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696395657413 (+8 ms) 2023-10-04 05:00:57,416 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 05:00:57,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 161 msec 2023-10-04 05:00:57,557 DEBUG [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 05:00:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 05:00:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 05:00:57,561 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561 2023-10-04 05:00:57,561 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34757, tgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561, rawTgtDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561, srcFsUri=hdfs://localhost:34757, srcDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:57,588 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0 2023-10-04 05:00:57,588 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-482126430_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,588 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34757, inputRoot=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0, snapshotDir=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-04 05:00:57,595 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:00:57,612 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,613 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,613 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,613 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,614 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,614 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,614 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,671 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/hadoop-5726514548662504704.jar 2023-10-04 05:00:57,672 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,672 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,672 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,672 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,673 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,673 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 05:00:57,673 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 05:00:57,673 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 05:00:57,674 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 05:00:57,674 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 05:00:57,674 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 05:00:57,674 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 05:00:57,675 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 05:00:57,675 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 05:00:57,675 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 05:00:57,675 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 05:00:57,676 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:57,676 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:57,676 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:57,676 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:57,677 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 05:00:57,677 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:57,677 DEBUG [Listener at jenkins-hbase20.apache.org/35111] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 05:00:58,027 WARN [Listener at jenkins-hbase20.apache.org/35111] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 05:00:58,029 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-04 05:00:58,030 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-04 05:01:00,177 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:01:00,177 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 05:01:00,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0006_000001 (auth:SIMPLE) 2023-10-04 05:01:01,176 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0007_000001 (auth:SIMPLE) 2023-10-04 05:01:01,469 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 05:01:04,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0007_000001 (auth:SIMPLE) 2023-10-04 05:01:06,720 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0007_000001 (auth:SIMPLE) 2023-10-04 05:01:08,801 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696395569426_0007_000001 (auth:SIMPLE) 2023-10-04 05:01:10,218 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 05:01:10,218 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 05:01:10,230 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,231 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 05:01:10,231 INFO [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 05:01:10,231 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,231 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 05:01:10,232 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 05:01:10,232 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947213829_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,232 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 05:01:10,232 DEBUG [Listener at jenkins-hbase20.apache.org/35111] snapshot.TestExportSnapshot(367): hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/export-test/export-1696395657561/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 05:01:10,238 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 05:01:10,242 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395670242"}]},"ts":"1696395670242"} 2023-10-04 05:01:10,244 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-04 05:01:10,245 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-04 05:01:10,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, UNASSIGN}] 2023-10-04 05:01:10,247 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, UNASSIGN 2023-10-04 05:01:10,247 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, UNASSIGN 2023-10-04 05:01:10,248 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8a18ccd2c36b8c3eaa440fbdad11026c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:01:10,248 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cc0a9f080c6b91e51692c5a373490a42, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:01:10,248 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395670248"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395670248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395670248"}]},"ts":"1696395670248"} 2023-10-04 05:01:10,248 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395670248"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696395670248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696395670248"}]},"ts":"1696395670248"} 2023-10-04 05:01:10,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 8a18ccd2c36b8c3eaa440fbdad11026c, server=jenkins-hbase20.apache.org,35697,1696395563431}] 2023-10-04 05:01:10,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure cc0a9f080c6b91e51692c5a373490a42, server=jenkins-hbase20.apache.org,46127,1696395563481}] 2023-10-04 05:01:10,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 05:01:10,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:01:10,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:01:10,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8a18ccd2c36b8c3eaa440fbdad11026c, disabling compactions & flushes 2023-10-04 05:01:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cc0a9f080c6b91e51692c5a373490a42, disabling compactions & flushes 2023-10-04 05:01:10,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:01:10,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:01:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:01:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:01:10,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. after waiting 0 ms 2023-10-04 05:01:10,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. after waiting 0 ms 2023-10-04 05:01:10,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:01:10,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:01:10,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:01:10,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:01:10,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:10,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:10,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c. 2023-10-04 05:01:10,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42. 2023-10-04 05:01:10,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8a18ccd2c36b8c3eaa440fbdad11026c: 2023-10-04 05:01:10,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cc0a9f080c6b91e51692c5a373490a42: 2023-10-04 05:01:10,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:01:10,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8a18ccd2c36b8c3eaa440fbdad11026c, regionState=CLOSED 2023-10-04 05:01:10,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395670424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395670424"}]},"ts":"1696395670424"} 2023-10-04 05:01:10,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:01:10,425 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cc0a9f080c6b91e51692c5a373490a42, regionState=CLOSED 2023-10-04 05:01:10,425 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696395670425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696395670425"}]},"ts":"1696395670425"} 2023-10-04 05:01:10,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-04 05:01:10,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 8a18ccd2c36b8c3eaa440fbdad11026c, server=jenkins-hbase20.apache.org,35697,1696395563431 in 176 msec 2023-10-04 05:01:10,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-04 05:01:10,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure cc0a9f080c6b91e51692c5a373490a42, server=jenkins-hbase20.apache.org,46127,1696395563481 in 176 msec 2023-10-04 05:01:10,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a18ccd2c36b8c3eaa440fbdad11026c, UNASSIGN in 182 msec 2023-10-04 05:01:10,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-04 05:01:10,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc0a9f080c6b91e51692c5a373490a42, UNASSIGN in 182 msec 2023-10-04 05:01:10,429 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696395670429"}]},"ts":"1696395670429"} 2023-10-04 05:01:10,430 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-04 05:01:10,431 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-04 05:01:10,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 193 msec 2023-10-04 05:01:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 05:01:10,547 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-04 05:01:10,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,555 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,557 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,559 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46127] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,561 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,561 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,561 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,561 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 05:01:10,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 05:01:10,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 05:01:10,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:01:10,562 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 05:01:10,563 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:01:10,563 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:01:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 05:01:10,565 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/recovered.edits] 2023-10-04 05:01:10,565 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/recovered.edits] 2023-10-04 05:01:10,569 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/cf/a68b02cb83454959bc0b6284ab2fc36a 2023-10-04 05:01:10,569 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/cf/cc4bc3f9b8954873a3d2c09fc1c51592 2023-10-04 05:01:10,571 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c/recovered.edits/9.seqid 2023-10-04 05:01:10,571 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/recovered.edits/9.seqid to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42/recovered.edits/9.seqid 2023-10-04 05:01:10,571 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a18ccd2c36b8c3eaa440fbdad11026c 2023-10-04 05:01:10,572 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc0a9f080c6b91e51692c5a373490a42 2023-10-04 05:01:10,572 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 05:01:10,572 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 05:01:10,572 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-04 05:01:10,575 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4 to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310043bd2e076a2624d1c9145d927a571ade4 2023-10-04 05:01:10,576 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c to hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004046444fcf9814bac8c90108fe1ec332c 2023-10-04 05:01:10,576 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 05:01:10,578 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,580 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-04 05:01:10,581 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-04 05:01:10,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-04 05:01:10,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395670582"}]},"ts":"9223372036854775807"} 2023-10-04 05:01:10,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696395670582"}]},"ts":"9223372036854775807"} 2023-10-04 05:01:10,584 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 05:01:10,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8a18ccd2c36b8c3eaa440fbdad11026c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696395656202.8a18ccd2c36b8c3eaa440fbdad11026c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc0a9f080c6b91e51692c5a373490a42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696395656202.cc0a9f080c6b91e51692c5a373490a42.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 05:01:10,584 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-04 05:01:10,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696395670584"}]},"ts":"9223372036854775807"} 2023-10-04 05:01:10,585 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-04 05:01:10,586 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-10-04 05:01:10,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 05:01:10,666 INFO [Listener at jenkins-hbase20.apache.org/35111] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-04 05:01:10,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 05:01:10,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 05:01:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38813] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 05:01:10,704 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=921 (was 960), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 223) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=1067 (was 940) - AvailableMemoryMB LEAK? - 2023-10-04 05:01:10,704 WARN [Listener at jenkins-hbase20.apache.org/35111] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-04 05:01:10,704 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-04 05:01:10,717 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 05:01:10,833 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696395569426_0007_01_000001 is : 143 2023-10-04 05:01:15,982 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 05:01:24,858 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 05:01:38,988 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 05:01:38,989 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 05:01:39,103 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-04 05:01:39,110 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-04 05:01:39,112 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 05:01:39,121 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-04 05:01:39,226 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 05:01:39,226 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-04 05:01:39,226 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-04 05:01:39,226 INFO [Listener at jenkins-hbase20.apache.org/35111] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-04 05:01:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/35111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1558f774 to 127.0.0.1:60951 2023-10-04 05:01:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/35111] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-04 05:01:39,228 DEBUG [Listener at jenkins-hbase20.apache.org/35111] util.JVMClusterUtil(257): Found active master hash=1067360559, stopped=false 2023-10-04 05:01:39,228 DEBUG [Listener at jenkins-hbase20.apache.org/35111] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,229 DEBUG [Listener at jenkins-hbase20.apache.org/35111] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 05:01:39,229 INFO [Listener at jenkins-hbase20.apache.org/35111] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 05:01:39,231 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 05:01:39,231 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 05:01:39,231 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 05:01:39,231 INFO [Listener at jenkins-hbase20.apache.org/35111] procedure2.ProcedureExecutor(628): Stopping 2023-10-04 05:01:39,231 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 05:01:39,231 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 05:01:39,232 DEBUG [Listener at jenkins-hbase20.apache.org/35111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x744fe6cd to 127.0.0.1:60951 2023-10-04 05:01:39,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 05:01:39,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 05:01:39,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 05:01:39,233 DEBUG [Listener at jenkins-hbase20.apache.org/35111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,233 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1064): Closing user regions 2023-10-04 05:01:39,233 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,35697,1696395563431' ***** 2023-10-04 05:01:39,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 05:01:39,233 DEBUG [Listener at jenkins-hbase20.apache.org/35111] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,233 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 05:01:39,233 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(3305): Received CLOSE for 0f288faf3884241968075d680c7c7cd9 2023-10-04 05:01:39,233 INFO [RS:0;jenkins-hbase20:35697] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 05:01:39,233 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,46127,1696395563481' ***** 2023-10-04 05:01:39,233 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1064): Closing user regions 2023-10-04 05:01:39,235 DEBUG [Listener at jenkins-hbase20.apache.org/35111] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,235 INFO [RS:0;jenkins-hbase20:35697] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 05:01:39,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0f288faf3884241968075d680c7c7cd9, disabling compactions & flushes 2023-10-04 05:01:39,235 INFO [RS:0;jenkins-hbase20:35697] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 05:01:39,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 05:01:39,235 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(3305): Received CLOSE for 588abd40188712389a363930197f4215 2023-10-04 05:01:39,235 INFO [RS:1;jenkins-hbase20:46127] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 05:01:39,235 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:01:39,235 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 05:01:39,235 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 05:01:39,235 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 05:01:39,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce2cdf489369ac08: from storage DS-cb040711-3714-4db4-9905-05c8c1cbdff3 node DatanodeRegistration(127.0.0.1:38567, datanodeUuid=207abf18-f6c6-4c73-b21d-1de1b071ab70, infoPort=39965, infoSecurePort=0, ipcPort=34989, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 29, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-04 05:01:39,236 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,41937,1696395563528' ***** 2023-10-04 05:01:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 588abd40188712389a363930197f4215, disabling compactions & flushes 2023-10-04 05:01:39,236 DEBUG [RS:0;jenkins-hbase20:35697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a18d4c9 to 127.0.0.1:60951 2023-10-04 05:01:39,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce2cdf489369ac08: from storage DS-1bd91f61-ddc6-4215-8e97-893024dd480d node DatanodeRegistration(127.0.0.1:38567, datanodeUuid=207abf18-f6c6-4c73-b21d-1de1b071ab70, infoPort=39965, infoSecurePort=0, ipcPort=34989, storageInfo=lv=-57;cid=testClusterID;nsid=650180970;c=1696395559485), blocks: 33, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 05:01:39,235 INFO [RS:1;jenkins-hbase20:46127] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 05:01:39,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 05:01:39,236 INFO [RS:1;jenkins-hbase20:46127] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 05:01:39,236 DEBUG [RS:0;jenkins-hbase20:35697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 05:01:39,238 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 05:01:39,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 05:01:39,236 DEBUG [Listener at jenkins-hbase20.apache.org/35111] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. after waiting 0 ms 2023-10-04 05:01:39,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 05:01:39,238 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1478): Online Regions={588abd40188712389a363930197f4215=hbase:namespace,,1696395565514.588abd40188712389a363930197f4215.} 2023-10-04 05:01:39,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 588abd40188712389a363930197f4215 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-04 05:01:39,236 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:01:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. after waiting 0 ms 2023-10-04 05:01:39,239 DEBUG [RS:1;jenkins-hbase20:46127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aa3133f to 127.0.0.1:60951 2023-10-04 05:01:39,238 INFO [Listener at jenkins-hbase20.apache.org/35111] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 05:01:39,239 DEBUG [RS:1;jenkins-hbase20:46127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 05:01:39,239 INFO [RS:2;jenkins-hbase20:41937] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 05:01:39,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 0f288faf3884241968075d680c7c7cd9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-04 05:01:39,240 DEBUG [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1504): Waiting on 588abd40188712389a363930197f4215 2023-10-04 05:01:39,239 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 05:01:39,239 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 05:01:39,239 INFO [RS:2;jenkins-hbase20:41937] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 05:01:39,240 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1478): Online Regions={0f288faf3884241968075d680c7c7cd9=hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9.} 2023-10-04 05:01:39,240 INFO [RS:2;jenkins-hbase20:41937] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 05:01:39,240 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:01:39,240 DEBUG [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1504): Waiting on 0f288faf3884241968075d680c7c7cd9 2023-10-04 05:01:39,240 DEBUG [RS:2;jenkins-hbase20:41937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a6c6eb to 127.0.0.1:60951 2023-10-04 05:01:39,240 DEBUG [RS:2;jenkins-hbase20:41937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,241 INFO [RS:2;jenkins-hbase20:41937] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 05:01:39,241 INFO [RS:2;jenkins-hbase20:41937] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 05:01:39,241 INFO [RS:2;jenkins-hbase20:41937] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 05:01:39,241 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-04 05:01:39,241 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 05:01:39,242 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 05:01:39,242 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-04 05:01:39,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 05:01:39,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 05:01:39,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 05:01:39,243 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-04 05:01:39,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 05:01:39,244 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-04 05:01:39,267 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,276 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/.tmp/l/0421be3f460c44498b75302c8dbf5ee0 2023-10-04 05:01:39,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/.tmp/info/2a80f4a318254a2eafd4f4c5d14534bb 2023-10-04 05:01:39,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0421be3f460c44498b75302c8dbf5ee0 2023-10-04 05:01:39,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/.tmp/l/0421be3f460c44498b75302c8dbf5ee0 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/l/0421be3f460c44498b75302c8dbf5ee0 2023-10-04 05:01:39,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0421be3f460c44498b75302c8dbf5ee0 2023-10-04 05:01:39,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/l/0421be3f460c44498b75302c8dbf5ee0, entries=7, sequenceid=18, filesize=5.2 K 2023-10-04 05:01:39,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/.tmp/info/2a80f4a318254a2eafd4f4c5d14534bb as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/info/2a80f4a318254a2eafd4f4c5d14534bb 2023-10-04 05:01:39,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0f288faf3884241968075d680c7c7cd9 in 50ms, sequenceid=18, compaction requested=false 2023-10-04 05:01:39,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/acl/0f288faf3884241968075d680c7c7cd9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-04 05:01:39,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 05:01:39,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0f288faf3884241968075d680c7c7cd9: 2023-10-04 05:01:39,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696395566276.0f288faf3884241968075d680c7c7cd9. 2023-10-04 05:01:39,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/info/2a80f4a318254a2eafd4f4c5d14534bb, entries=2, sequenceid=6, filesize=4.8 K 2023-10-04 05:01:39,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 588abd40188712389a363930197f4215 in 59ms, sequenceid=6, compaction requested=false 2023-10-04 05:01:39,298 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/namespace/588abd40188712389a363930197f4215/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 05:01:39,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 05:01:39,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 588abd40188712389a363930197f4215: 2023-10-04 05:01:39,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696395565514.588abd40188712389a363930197f4215. 2023-10-04 05:01:39,440 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,35697,1696395563431; all regions closed. 2023-10-04 05:01:39,440 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,46127,1696395563481; all regions closed. 2023-10-04 05:01:39,443 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-04 05:01:39,451 DEBUG [RS:1;jenkins-hbase20:46127] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs 2023-10-04 05:01:39,451 DEBUG [RS:0;jenkins-hbase20:35697] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs 2023-10-04 05:01:39,451 INFO [RS:1;jenkins-hbase20:46127] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46127%2C1696395563481:(num 1696395565123) 2023-10-04 05:01:39,451 INFO [RS:0;jenkins-hbase20:35697] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35697%2C1696395563431:(num 1696395565123) 2023-10-04 05:01:39,451 DEBUG [RS:0;jenkins-hbase20:35697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,451 DEBUG [RS:1;jenkins-hbase20:46127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,451 INFO [RS:0;jenkins-hbase20:35697] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,451 INFO [RS:1;jenkins-hbase20:46127] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,451 INFO [RS:1;jenkins-hbase20:46127] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 05:01:39,451 INFO [RS:0;jenkins-hbase20:35697] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-04 05:01:39,452 INFO [RS:1;jenkins-hbase20:46127] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 05:01:39,452 INFO [RS:0;jenkins-hbase20:35697] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 05:01:39,452 INFO [RS:1;jenkins-hbase20:46127] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 05:01:39,452 INFO [RS:1;jenkins-hbase20:46127] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 05:01:39,452 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 05:01:39,452 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 05:01:39,452 INFO [RS:0;jenkins-hbase20:35697] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 05:01:39,452 INFO [RS:0;jenkins-hbase20:35697] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 05:01:39,453 INFO [RS:1;jenkins-hbase20:46127] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46127 2023-10-04 05:01:39,453 INFO [RS:0;jenkins-hbase20:35697] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35697 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35697,1696395563431 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:01:39,458 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46127,1696395563481 2023-10-04 05:01:39,459 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46127,1696395563481] 2023-10-04 05:01:39,459 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46127,1696395563481; numProcessing=1 2023-10-04 05:01:39,460 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46127,1696395563481 already deleted, retry=false 2023-10-04 05:01:39,460 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46127,1696395563481 expired; onlineServers=2 2023-10-04 05:01:39,460 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35697,1696395563431] 2023-10-04 05:01:39,460 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35697,1696395563431; numProcessing=2 2023-10-04 05:01:39,461 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35697,1696395563431 already deleted, retry=false 2023-10-04 05:01:39,461 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35697,1696395563431 expired; onlineServers=1 2023-10-04 05:01:39,560 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,560 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:35697-0x100fb50db750001, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,560 INFO [RS:0;jenkins-hbase20:35697] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,35697,1696395563431; zookeeper connection closed. 2023-10-04 05:01:39,560 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4fdca4fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4fdca4fa 2023-10-04 05:01:39,643 DEBUG [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-04 05:01:39,660 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,660 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:46127-0x100fb50db750002, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,660 INFO [RS:1;jenkins-hbase20:46127] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,46127,1696395563481; zookeeper connection closed. 2023-10-04 05:01:39,661 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f91d6fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f91d6fd 2023-10-04 05:01:39,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/info/fa53dc2bae4a4bf99cf92807f88b1c02 2023-10-04 05:01:39,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa53dc2bae4a4bf99cf92807f88b1c02 2023-10-04 05:01:39,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/rep_barrier/ed6a9400ef324dbea611ac9291778dbd 2023-10-04 05:01:39,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed6a9400ef324dbea611ac9291778dbd 2023-10-04 05:01:39,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/table/3c9010f6e5b1434e8739bd0f8f414252 2023-10-04 05:01:39,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9010f6e5b1434e8739bd0f8f414252 2023-10-04 05:01:39,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/info/fa53dc2bae4a4bf99cf92807f88b1c02 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/info/fa53dc2bae4a4bf99cf92807f88b1c02 2023-10-04 05:01:39,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa53dc2bae4a4bf99cf92807f88b1c02 2023-10-04 05:01:39,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/info/fa53dc2bae4a4bf99cf92807f88b1c02, entries=48, sequenceid=131, filesize=10.3 K 2023-10-04 05:01:39,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/rep_barrier/ed6a9400ef324dbea611ac9291778dbd as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/rep_barrier/ed6a9400ef324dbea611ac9291778dbd 2023-10-04 05:01:39,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed6a9400ef324dbea611ac9291778dbd 2023-10-04 05:01:39,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/rep_barrier/ed6a9400ef324dbea611ac9291778dbd, entries=13, sequenceid=131, filesize=6.4 K 2023-10-04 05:01:39,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/.tmp/table/3c9010f6e5b1434e8739bd0f8f414252 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/table/3c9010f6e5b1434e8739bd0f8f414252 2023-10-04 05:01:39,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9010f6e5b1434e8739bd0f8f414252 2023-10-04 05:01:39,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/table/3c9010f6e5b1434e8739bd0f8f414252, entries=24, sequenceid=131, filesize=6.9 K 2023-10-04 05:01:39,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 501ms, sequenceid=131, compaction requested=false 2023-10-04 05:01:39,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-04 05:01:39,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 05:01:39,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 05:01:39,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 05:01:39,754 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 05:01:39,754 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-04 05:01:39,843 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,41937,1696395563528; all regions closed. 2023-10-04 05:01:39,849 DEBUG [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs 2023-10-04 05:01:39,849 INFO [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41937%2C1696395563528.meta:.meta(num 1696395565249) 2023-10-04 05:01:39,855 DEBUG [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/oldWALs 2023-10-04 05:01:39,855 INFO [RS:2;jenkins-hbase20:41937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41937%2C1696395563528:(num 1696395565123) 2023-10-04 05:01:39,855 DEBUG [RS:2;jenkins-hbase20:41937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,855 INFO [RS:2;jenkins-hbase20:41937] regionserver.LeaseManager(133): Closed leases 2023-10-04 05:01:39,855 INFO [RS:2;jenkins-hbase20:41937] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-04 05:01:39,855 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 05:01:39,856 INFO [RS:2;jenkins-hbase20:41937] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41937 2023-10-04 05:01:39,857 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41937,1696395563528 2023-10-04 05:01:39,857 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 05:01:39,858 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41937,1696395563528] 2023-10-04 05:01:39,858 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41937,1696395563528; numProcessing=3 2023-10-04 05:01:39,859 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41937,1696395563528 already deleted, retry=false 2023-10-04 05:01:39,859 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41937,1696395563528 expired; onlineServers=0 2023-10-04 05:01:39,859 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38813,1696395562368' ***** 2023-10-04 05:01:39,859 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-04 05:01:39,859 DEBUG [M:0;jenkins-hbase20:38813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ea3ab14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-04 05:01:39,859 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38813,1696395562368 2023-10-04 05:01:39,859 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38813,1696395562368; all regions closed. 2023-10-04 05:01:39,859 DEBUG [M:0;jenkins-hbase20:38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 05:01:39,859 DEBUG [M:0;jenkins-hbase20:38813] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-04 05:01:39,860 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-04 05:01:39,860 DEBUG [M:0;jenkins-hbase20:38813] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-04 05:01:39,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696395564761] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696395564761,5,FailOnTimeoutGroup] 2023-10-04 05:01:39,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696395564761] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696395564761,5,FailOnTimeoutGroup] 2023-10-04 05:01:39,860 INFO [M:0;jenkins-hbase20:38813] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-04 05:01:39,860 INFO [M:0;jenkins-hbase20:38813] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-04 05:01:39,860 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-04 05:01:39,860 INFO [M:0;jenkins-hbase20:38813] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-04 05:01:39,860 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 05:01:39,860 DEBUG [M:0;jenkins-hbase20:38813] master.HMaster(1512): Stopping service threads 2023-10-04 05:01:39,860 INFO [M:0;jenkins-hbase20:38813] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-04 05:01:39,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 05:01:39,860 ERROR [M:0;jenkins-hbase20:38813] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-04 05:01:39,861 INFO [M:0;jenkins-hbase20:38813] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-04 05:01:39,861 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-04 05:01:39,861 DEBUG [M:0;jenkins-hbase20:38813] zookeeper.ZKUtil(398): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-04 05:01:39,861 WARN [M:0;jenkins-hbase20:38813] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-04 05:01:39,861 INFO [M:0;jenkins-hbase20:38813] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-04 05:01:39,862 INFO [M:0;jenkins-hbase20:38813] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-04 05:01:39,862 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 05:01:39,862 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 05:01:39,862 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 05:01:39,862 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 05:01:39,862 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 05:01:39,862 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.06 KB heapSize=452.28 KB 2023-10-04 05:01:39,876 INFO [M:0;jenkins-hbase20:38813] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.06 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8e97bbf0e23f449fba51b32b8ee9e4c3 2023-10-04 05:01:39,879 INFO [M:0;jenkins-hbase20:38813] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e97bbf0e23f449fba51b32b8ee9e4c3 2023-10-04 05:01:39,880 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8e97bbf0e23f449fba51b32b8ee9e4c3 as hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8e97bbf0e23f449fba51b32b8ee9e4c3 2023-10-04 05:01:39,885 INFO [M:0;jenkins-hbase20:38813] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e97bbf0e23f449fba51b32b8ee9e4c3 2023-10-04 05:01:39,885 INFO [M:0;jenkins-hbase20:38813] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/ae370e9c-ce64-69b0-656c-75696b3d38d0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8e97bbf0e23f449fba51b32b8ee9e4c3, entries=119, sequenceid=899, filesize=28.6 K 2023-10-04 05:01:39,886 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegion(2948): Finished flush of dataSize ~376.06 KB/385090, heapSize ~452.27 KB/463120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-10-04 05:01:39,887 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 05:01:39,887 DEBUG [M:0;jenkins-hbase20:38813] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 05:01:39,891 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 05:01:39,891 INFO [M:0;jenkins-hbase20:38813] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-04 05:01:39,891 INFO [M:0;jenkins-hbase20:38813] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38813 2023-10-04 05:01:39,892 DEBUG [M:0;jenkins-hbase20:38813] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,38813,1696395562368 already deleted, retry=false 2023-10-04 05:01:39,958 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,959 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): regionserver:41937-0x100fb50db750003, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:39,958 INFO [RS:2;jenkins-hbase20:41937] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,41937,1696395563528; zookeeper connection closed. 2023-10-04 05:01:39,959 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@183af418] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@183af418 2023-10-04 05:01:39,959 INFO [Listener at jenkins-hbase20.apache.org/35111] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-04 05:01:40,059 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:40,059 DEBUG [Listener at localhost/41961-EventThread] zookeeper.ZKWatcher(600): master:38813-0x100fb50db750000, quorum=127.0.0.1:60951, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 05:01:40,059 INFO [M:0;jenkins-hbase20:38813] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38813,1696395562368; zookeeper connection closed. 2023-10-04 05:01:40,062 WARN [Listener at jenkins-hbase20.apache.org/35111] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 05:01:40,068 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 05:01:40,176 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 05:01:40,176 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2041444711-148.251.75.209-1696395559485 (Datanode Uuid c7dc3ce1-d55b-4c2d-8f0c-467f123b29d4) service to localhost/127.0.0.1:34757 2023-10-04 05:01:40,179 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data5/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,179 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data6/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,180 WARN [Listener at jenkins-hbase20.apache.org/35111] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 05:01:40,183 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 05:01:40,291 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 05:01:40,292 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2041444711-148.251.75.209-1696395559485 (Datanode Uuid 61d4b0f2-ae36-4fa7-b9d2-1942b40388cf) service to localhost/127.0.0.1:34757 2023-10-04 05:01:40,293 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data3/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data4/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,294 WARN [Listener at jenkins-hbase20.apache.org/35111] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 05:01:40,296 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 05:01:40,400 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 05:01:40,400 WARN [BP-2041444711-148.251.75.209-1696395559485 heartbeating to localhost/127.0.0.1:34757] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2041444711-148.251.75.209-1696395559485 (Datanode Uuid 207abf18-f6c6-4c73-b21d-1de1b071ab70) service to localhost/127.0.0.1:34757 2023-10-04 05:01:40,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data1/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,402 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1d2782a2-7533-5751-86f2-219bd4c0cf17/cluster_6a806611-2942-b409-0ee9-6ccdcd1f4e8e/dfs/data/data2/current/BP-2041444711-148.251.75.209-1696395559485] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 05:01:40,436 INFO [Listener at jenkins-hbase20.apache.org/35111] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 05:01:40,566 INFO [Listener at jenkins-hbase20.apache.org/35111] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-04 05:01:40,637 INFO [Listener at jenkins-hbase20.apache.org/35111] hbase.HBaseTestingUtility(1293): Minicluster is down