2023-07-15 22:10:55,923 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 22:10:56,186 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712 2023-07-15 22:10:56,186 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-15 22:10:56,187 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-15 22:10:56,225 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 22:10:56,475 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 22:10:56,475 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2, deleteOnExit=true 2023-07-15 22:10:56,475 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 22:10:56,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/test.cache.data in system properties and HBase conf 2023-07-15 22:10:56,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 22:10:56,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop.log.dir in system properties and HBase conf 2023-07-15 22:10:56,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 22:10:56,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 22:10:56,478 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 22:10:56,791 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 22:10:56,798 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:10:56,798 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:10:56,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 22:10:56,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:10:56,800 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 22:10:56,800 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 22:10:56,803 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:10:56,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:10:56,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 22:10:56,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/nfs.dump.dir in system properties and HBase conf 2023-07-15 22:10:56,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir in system properties and HBase conf 2023-07-15 22:10:56,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:10:56,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 22:10:56,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 22:10:57,405 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 22:10:57,409 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 22:10:57,691 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 22:10:57,867 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 22:10:57,884 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:57,918 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:57,948 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_localhost_37929_hdfs____iko1dy/webapp 2023-07-15 22:10:58,098 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37929 2023-07-15 22:10:58,152 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 22:10:58,152 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 22:10:58,748 WARN [Listener at localhost/38251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:58,858 WARN [Listener at localhost/38251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:58,886 WARN [Listener at localhost/38251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:58,893 INFO [Listener at localhost/38251] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:58,900 INFO [Listener at localhost/38251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_localhost_46361_datanode____.hqpuwd/webapp 2023-07-15 22:10:59,044 INFO [Listener at localhost/38251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46361 2023-07-15 22:10:59,536 WARN [Listener at localhost/33055] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:59,562 WARN [Listener at localhost/33055] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:59,566 WARN [Listener at localhost/33055] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:59,569 INFO [Listener at localhost/33055] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:59,575 INFO [Listener at localhost/33055] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_localhost_36269_datanode____.wud5gn/webapp 2023-07-15 22:10:59,701 INFO [Listener at localhost/33055] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36269 2023-07-15 22:10:59,714 WARN [Listener at localhost/36225] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:59,758 WARN [Listener at localhost/36225] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:59,762 WARN [Listener at localhost/36225] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:59,764 INFO [Listener at localhost/36225] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:59,776 INFO [Listener at localhost/36225] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_localhost_46385_datanode____h5nv6d/webapp 2023-07-15 22:10:59,926 INFO [Listener at localhost/36225] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46385 2023-07-15 22:10:59,939 WARN [Listener at localhost/36625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:11:00,238 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3a6a779b0d03188: Processing first storage report for DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae from datanode f638764a-42e8-4d06-9c08-6dd883a91693 2023-07-15 22:11:00,241 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3a6a779b0d03188: from storage DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae node DatanodeRegistration(127.0.0.1:40319, datanodeUuid=f638764a-42e8-4d06-9c08-6dd883a91693, infoPort=39851, infoSecurePort=0, ipcPort=36625, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,241 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x84a5da71fe167d5e: Processing first storage report for DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b from datanode 036dad71-9a3f-4dbe-9eb6-b57b1fa85120 2023-07-15 22:11:00,241 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x84a5da71fe167d5e: from storage DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b node DatanodeRegistration(127.0.0.1:33375, datanodeUuid=036dad71-9a3f-4dbe-9eb6-b57b1fa85120, infoPort=33859, infoSecurePort=0, ipcPort=33055, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,241 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcbf269eb107bdfac: Processing first storage report for DS-da20227d-0d4d-4fc7-bdf4-1017b216a321 from datanode cd480aee-e016-41f6-906f-3127f28d28ba 2023-07-15 22:11:00,242 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcbf269eb107bdfac: from storage DS-da20227d-0d4d-4fc7-bdf4-1017b216a321 node DatanodeRegistration(127.0.0.1:36719, datanodeUuid=cd480aee-e016-41f6-906f-3127f28d28ba, infoPort=44485, infoSecurePort=0, ipcPort=36225, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,242 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3a6a779b0d03188: Processing first storage report for DS-66b16893-b7fb-4bac-a7f2-53c7fe652f11 from datanode f638764a-42e8-4d06-9c08-6dd883a91693 2023-07-15 22:11:00,242 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3a6a779b0d03188: from storage DS-66b16893-b7fb-4bac-a7f2-53c7fe652f11 node DatanodeRegistration(127.0.0.1:40319, datanodeUuid=f638764a-42e8-4d06-9c08-6dd883a91693, infoPort=39851, infoSecurePort=0, ipcPort=36625, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,242 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x84a5da71fe167d5e: Processing first storage report for DS-4e967c9e-a661-45d8-b85e-05f919c5d8ad from datanode 036dad71-9a3f-4dbe-9eb6-b57b1fa85120 2023-07-15 22:11:00,242 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x84a5da71fe167d5e: from storage DS-4e967c9e-a661-45d8-b85e-05f919c5d8ad node DatanodeRegistration(127.0.0.1:33375, datanodeUuid=036dad71-9a3f-4dbe-9eb6-b57b1fa85120, infoPort=33859, infoSecurePort=0, ipcPort=33055, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,243 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcbf269eb107bdfac: Processing first storage report for DS-118acf19-aa76-460e-b90b-29427b87a7ad from datanode cd480aee-e016-41f6-906f-3127f28d28ba 2023-07-15 22:11:00,243 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcbf269eb107bdfac: from storage DS-118acf19-aa76-460e-b90b-29427b87a7ad node DatanodeRegistration(127.0.0.1:36719, datanodeUuid=cd480aee-e016-41f6-906f-3127f28d28ba, infoPort=44485, infoSecurePort=0, ipcPort=36225, storageInfo=lv=-57;cid=testClusterID;nsid=1669636482;c=1689459057484), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,447 DEBUG [Listener at localhost/36625] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712 2023-07-15 22:11:00,499 DEBUG [Listener at localhost/36625] zookeeper.MiniZooKeeperCluster(243): Failed binding ZK Server to client port: 53850 java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:461) at sun.nio.ch.Net.bind(Net.java:453) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:78) at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:687) at org.apache.zookeeper.server.ServerCnxnFactory.configure(ServerCnxnFactory.java:76) at org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster.startup(MiniZooKeeperCluster.java:239) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:129) at org.apache.hadoop.hbase.HBaseZKTestingUtility.startMiniZKCluster(HBaseZKTestingUtility.java:102) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1090) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.setUpBeforeClass(TestMobSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:00,544 INFO [Listener at localhost/36625] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/zookeeper_0, clientPort=53851, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 22:11:00,562 INFO [Listener at localhost/36625] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53851 2023-07-15 22:11:00,574 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:00,577 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:01,271 INFO [Listener at localhost/36625] util.FSUtils(471): Created version file at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 with version=8 2023-07-15 22:11:01,271 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/hbase-staging 2023-07-15 22:11:01,646 INFO [Listener at localhost/36625] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 22:11:02,372 INFO [Listener at localhost/36625] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:02,421 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,422 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,422 INFO [Listener at localhost/36625] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:02,423 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,423 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:02,609 INFO [Listener at localhost/36625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:02,713 DEBUG [Listener at localhost/36625] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 22:11:02,818 INFO [Listener at localhost/36625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41943 2023-07-15 22:11:02,832 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:02,834 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:02,857 INFO [Listener at localhost/36625] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41943 connecting to ZooKeeper ensemble=127.0.0.1:53851 2023-07-15 22:11:02,916 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:419430x0, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:02,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41943-0x1016b09f22c0000 connected 2023-07-15 22:11:02,957 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:02,958 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:02,977 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:02,991 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41943 2023-07-15 22:11:02,991 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41943 2023-07-15 22:11:02,992 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41943 2023-07-15 22:11:02,993 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41943 2023-07-15 22:11:02,994 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41943 2023-07-15 22:11:03,001 INFO [Listener at localhost/36625] master.HMaster(444): hbase.rootdir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, hbase.cluster.distributed=false 2023-07-15 22:11:03,075 INFO [Listener at localhost/36625] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,075 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,075 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,076 INFO [Listener at localhost/36625] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,076 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,076 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,082 INFO [Listener at localhost/36625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,090 INFO [Listener at localhost/36625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45695 2023-07-15 22:11:03,094 INFO [Listener at localhost/36625] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,104 INFO [Listener at localhost/36625] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 22:11:03,106 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,108 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,110 INFO [Listener at localhost/36625] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45695 connecting to ZooKeeper ensemble=127.0.0.1:53851 2023-07-15 22:11:03,114 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:456950x0, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,114 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:456950x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,119 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:456950x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45695-0x1016b09f22c0001 connected 2023-07-15 22:11:03,120 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,125 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45695 2023-07-15 22:11:03,126 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45695 2023-07-15 22:11:03,127 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45695 2023-07-15 22:11:03,131 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45695 2023-07-15 22:11:03,134 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45695 2023-07-15 22:11:03,149 INFO [Listener at localhost/36625] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,149 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,149 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,150 INFO [Listener at localhost/36625] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,150 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,150 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,150 INFO [Listener at localhost/36625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,152 INFO [Listener at localhost/36625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33297 2023-07-15 22:11:03,152 INFO [Listener at localhost/36625] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,153 INFO [Listener at localhost/36625] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 22:11:03,154 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,161 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,164 INFO [Listener at localhost/36625] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33297 connecting to ZooKeeper ensemble=127.0.0.1:53851 2023-07-15 22:11:03,169 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:332970x0, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,170 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:332970x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33297-0x1016b09f22c0002 connected 2023-07-15 22:11:03,171 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,172 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,179 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-15 22:11:03,179 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33297 2023-07-15 22:11:03,179 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33297 2023-07-15 22:11:03,183 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-15 22:11:03,183 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,196 INFO [Listener at localhost/36625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,199 INFO [Listener at localhost/36625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45299 2023-07-15 22:11:03,200 INFO [Listener at localhost/36625] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,207 INFO [Listener at localhost/36625] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 22:11:03,209 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,211 INFO [Listener at localhost/36625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,212 INFO [Listener at localhost/36625] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45299 connecting to ZooKeeper ensemble=127.0.0.1:53851 2023-07-15 22:11:03,225 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:452990x0, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,226 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:452990x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,227 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:452990x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,228 DEBUG [Listener at localhost/36625] zookeeper.ZKUtil(164): regionserver:452990x0, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,229 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45299 2023-07-15 22:11:03,229 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45299 2023-07-15 22:11:03,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45299-0x1016b09f22c0003 connected 2023-07-15 22:11:03,230 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45299 2023-07-15 22:11:03,238 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45299 2023-07-15 22:11:03,239 DEBUG [Listener at localhost/36625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45299 2023-07-15 22:11:03,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:03,256 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 22:11:03,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:03,281 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,281 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,282 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:03,281 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,281 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 22:11:03,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41943,1689459061444 from backup master directory 2023-07-15 22:11:03,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 22:11:03,294 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:03,294 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 22:11:03,295 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:03,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:03,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 22:11:03,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 22:11:03,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/hbase.id with ID: a20dc9d8-f42a-43bc-b1fb-7ae606e4835c 2023-07-15 22:11:03,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,488 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:03,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1dd40eb5 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:03,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@176f6fc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:03,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:03,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 22:11:03,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 22:11:03,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 22:11:03,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:03,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:03,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:03,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store-tmp 2023-07-15 22:11:03,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:03,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 22:11:03,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 22:11:03,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:11:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/WALs/jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:03,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41943%2C1689459061444, suffix=, logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/WALs/jenkins-hbase4.apache.org,41943,1689459061444, archiveDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/oldWALs, maxLogs=10 2023-07-15 22:11:03,872 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK] 2023-07-15 22:11:03,872 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK] 2023-07-15 22:11:03,872 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK] 2023-07-15 22:11:03,881 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:03,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/WALs/jenkins-hbase4.apache.org,41943,1689459061444/jenkins-hbase4.apache.org%2C41943%2C1689459061444.1689459063807 2023-07-15 22:11:03,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK], DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK], DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK]] 2023-07-15 22:11:03,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:03,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:03,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:03,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,070 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,078 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 22:11:04,116 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 22:11:04,132 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:04,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:04,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64337776, jitterRate=-0.041292428970336914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:04,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:11:04,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 22:11:04,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 22:11:04,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 22:11:04,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 22:11:04,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 22:11:04,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-15 22:11:04,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 22:11:04,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 22:11:04,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 22:11:04,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 22:11:04,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 22:11:04,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 22:11:04,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 22:11:04,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 22:11:04,368 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 22:11:04,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 22:11:04,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 22:11:04,393 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,393 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,393 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,393 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,393 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41943,1689459061444, sessionid=0x1016b09f22c0000, setting cluster-up flag (Was=false) 2023-07-15 22:11:04,414 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 22:11:04,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:04,435 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 22:11:04,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:04,445 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp 2023-07-15 22:11:04,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 22:11:04,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 22:11:04,544 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(951): ClusterId : a20dc9d8-f42a-43bc-b1fb-7ae606e4835c 2023-07-15 22:11:04,544 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(951): ClusterId : a20dc9d8-f42a-43bc-b1fb-7ae606e4835c 2023-07-15 22:11:04,545 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(951): ClusterId : a20dc9d8-f42a-43bc-b1fb-7ae606e4835c 2023-07-15 22:11:04,554 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,556 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,554 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,564 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,564 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,565 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,565 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,565 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,565 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,572 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,573 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,575 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ReadOnlyZKClient(139): Connect 0x073fd2ba to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,576 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ReadOnlyZKClient(139): Connect 0x7c9fc559 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,580 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,583 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ReadOnlyZKClient(139): Connect 0x6c545539 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,606 DEBUG [RS:2;jenkins-hbase4:45299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5654c333, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,607 DEBUG [RS:2;jenkins-hbase4:45299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bad9810, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,633 DEBUG [RS:0;jenkins-hbase4:45695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@226c728e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,633 DEBUG [RS:0;jenkins-hbase4:45695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d973fba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,636 DEBUG [RS:1;jenkins-hbase4:33297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@442198c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,637 DEBUG [RS:1;jenkins-hbase4:33297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b424723, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,648 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33297 2023-07-15 22:11:04,651 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45695 2023-07-15 22:11:04,649 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45299 2023-07-15 22:11:04,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:04,655 INFO [RS:1;jenkins-hbase4:33297] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,655 INFO [RS:0;jenkins-hbase4:45695] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,655 INFO [RS:1;jenkins-hbase4:33297] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,655 INFO [RS:2;jenkins-hbase4:45299] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,662 INFO [RS:2;jenkins-hbase4:45299] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,656 INFO [RS:0;jenkins-hbase4:45695] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,662 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,663 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,656 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,664 INFO [RS:2;jenkins-hbase4:45299] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,664 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,664 INFO [RS:1;jenkins-hbase4:33297] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,664 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,664 INFO [RS:0;jenkins-hbase4:45695] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,665 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,669 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41943,1689459061444 with isa=jenkins-hbase4.apache.org/172.31.14.131:33297, startcode=1689459063148 2023-07-15 22:11:04,670 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41943,1689459061444 with isa=jenkins-hbase4.apache.org/172.31.14.131:45299, startcode=1689459063195 2023-07-15 22:11:04,669 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41943,1689459061444 with isa=jenkins-hbase4.apache.org/172.31.14.131:45695, startcode=1689459063074 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:04,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:04,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689459094682 2023-07-15 22:11:04,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 22:11:04,695 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:04,696 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 22:11:04,699 DEBUG [RS:2;jenkins-hbase4:45299] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,700 DEBUG [RS:0;jenkins-hbase4:45695] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,699 DEBUG [RS:1;jenkins-hbase4:33297] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 22:11:04,703 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:04,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 22:11:04,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 22:11:04,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 22:11:04,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 22:11:04,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:04,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 22:11:04,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 22:11:04,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 22:11:04,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 22:11:04,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 22:11:04,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459064764,5,FailOnTimeoutGroup] 2023-07-15 22:11:04,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459064766,5,FailOnTimeoutGroup] 2023-07-15 22:11:04,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:04,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 22:11:04,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:04,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:04,804 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55245, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:04,804 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53851, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:04,804 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38893, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:04,861 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41943] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,880 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41943] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,883 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:04,885 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:04,885 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:04,887 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41943] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,890 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:04,890 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:04,890 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:04,890 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38251 2023-07-15 22:11:04,890 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:04,890 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38251 2023-07-15 22:11:04,895 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:04,890 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38251 2023-07-15 22:11:04,898 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:04,901 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:11:04,903 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,904 WARN [RS:1;jenkins-hbase4:33297] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:04,904 INFO [RS:1;jenkins-hbase4:33297] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:04,904 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,905 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ZKUtil(162): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,905 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ZKUtil(162): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,905 WARN [RS:0;jenkins-hbase4:45695] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:04,906 WARN [RS:2;jenkins-hbase4:45299] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:04,912 INFO [RS:2;jenkins-hbase4:45299] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:04,912 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,911 INFO [RS:0;jenkins-hbase4:45695] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:04,912 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,927 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45695,1689459063074] 2023-07-15 22:11:04,927 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45299,1689459063195] 2023-07-15 22:11:04,927 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33297,1689459063148] 2023-07-15 22:11:04,973 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ZKUtil(162): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,973 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ZKUtil(162): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,975 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:04,976 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ZKUtil(162): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,976 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ZKUtil(162): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,977 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:04,977 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ZKUtil(162): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,977 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ZKUtil(162): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,978 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:04,979 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:04,990 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 22:11:04,994 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/info 2023-07-15 22:11:04,994 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:04,994 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:04,994 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:04,995 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 22:11:04,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:04,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 22:11:05,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:05,005 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 22:11:05,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 22:11:05,008 INFO [RS:2;jenkins-hbase4:45299] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/table 2023-07-15 22:11:05,014 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 22:11:05,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,009 INFO [RS:1;jenkins-hbase4:33297] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,008 INFO [RS:0;jenkins-hbase4:45695] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,018 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740 2023-07-15 22:11:05,032 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740 2023-07-15 22:11:05,038 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 22:11:05,042 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 22:11:05,049 INFO [RS:2;jenkins-hbase4:45299] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,049 INFO [RS:0;jenkins-hbase4:45695] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,059 INFO [RS:1;jenkins-hbase4:33297] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,060 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:05,061 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71489461, jitterRate=0.06527598202228546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 22:11:05,061 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 22:11:05,062 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 22:11:05,062 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 22:11:05,062 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 22:11:05,062 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 22:11:05,062 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 22:11:05,073 INFO [RS:2;jenkins-hbase4:45299] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,073 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,074 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,074 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 22:11:05,074 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 22:11:05,074 INFO [RS:1;jenkins-hbase4:33297] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,074 INFO [RS:0;jenkins-hbase4:45695] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,080 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,079 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,080 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,082 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,085 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:05,086 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 22:11:05,089 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,089 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,090 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,090 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,090 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,090 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,091 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,090 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,092 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,091 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:0;jenkins-hbase4:45695] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,092 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,092 DEBUG [RS:1;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,093 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,093 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,093 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,093 DEBUG [RS:2;jenkins-hbase4:45299] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 22:11:05,103 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,103 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,103 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,108 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,108 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,108 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,123 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,123 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,123 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,133 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 22:11:05,140 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 22:11:05,148 INFO [RS:2;jenkins-hbase4:45299] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,148 INFO [RS:0;jenkins-hbase4:45695] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,153 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45299,1689459063195-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,153 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45695,1689459063074-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,154 INFO [RS:1;jenkins-hbase4:33297] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,154 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33297,1689459063148-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,187 INFO [RS:2;jenkins-hbase4:45299] regionserver.Replication(203): jenkins-hbase4.apache.org,45299,1689459063195 started 2023-07-15 22:11:05,187 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45299,1689459063195, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45299, sessionid=0x1016b09f22c0003 2023-07-15 22:11:05,189 INFO [RS:0;jenkins-hbase4:45695] regionserver.Replication(203): jenkins-hbase4.apache.org,45695,1689459063074 started 2023-07-15 22:11:05,189 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45695,1689459063074, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45695, sessionid=0x1016b09f22c0001 2023-07-15 22:11:05,189 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,189 DEBUG [RS:0;jenkins-hbase4:45695] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:05,189 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45695,1689459063074' 2023-07-15 22:11:05,189 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,189 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,191 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,192 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,192 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,192 DEBUG [RS:0;jenkins-hbase4:45695] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:05,192 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45695,1689459063074' 2023-07-15 22:11:05,192 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,193 INFO [RS:1;jenkins-hbase4:33297] regionserver.Replication(203): jenkins-hbase4.apache.org,33297,1689459063148 started 2023-07-15 22:11:05,193 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33297,1689459063148, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33297, sessionid=0x1016b09f22c0002 2023-07-15 22:11:05,193 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,194 DEBUG [RS:0;jenkins-hbase4:45695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,193 DEBUG [RS:1;jenkins-hbase4:33297] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:05,190 DEBUG [RS:2;jenkins-hbase4:45299] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:05,196 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33297,1689459063148' 2023-07-15 22:11:05,197 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,197 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45299,1689459063195' 2023-07-15 22:11:05,197 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,198 DEBUG [RS:0;jenkins-hbase4:45695] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,198 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,202 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,202 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,198 INFO [RS:0;jenkins-hbase4:45695] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,203 INFO [RS:0;jenkins-hbase4:45695] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,203 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,202 DEBUG [RS:2;jenkins-hbase4:45299] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:05,204 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45299,1689459063195' 2023-07-15 22:11:05,204 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,204 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,204 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,204 DEBUG [RS:1;jenkins-hbase4:33297] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:05,204 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33297,1689459063148' 2023-07-15 22:11:05,204 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,204 DEBUG [RS:2;jenkins-hbase4:45299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,205 DEBUG [RS:1;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,205 DEBUG [RS:2;jenkins-hbase4:45299] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,205 INFO [RS:2;jenkins-hbase4:45299] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,206 INFO [RS:2;jenkins-hbase4:45299] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,206 DEBUG [RS:1;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,206 INFO [RS:1;jenkins-hbase4:33297] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,207 INFO [RS:1;jenkins-hbase4:33297] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,292 DEBUG [jenkins-hbase4:41943] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 22:11:05,298 DEBUG [jenkins-hbase4:41943] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:05,304 DEBUG [jenkins-hbase4:41943] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:05,304 DEBUG [jenkins-hbase4:41943] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:05,304 DEBUG [jenkins-hbase4:41943] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:05,304 DEBUG [jenkins-hbase4:41943] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:05,308 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45299,1689459063195, state=OPENING 2023-07-15 22:11:05,320 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 22:11:05,320 INFO [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45299%2C1689459063195, suffix=, logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45299,1689459063195, archiveDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs, maxLogs=32 2023-07-15 22:11:05,321 INFO [RS:1;jenkins-hbase4:33297] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33297%2C1689459063148, suffix=, logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,33297,1689459063148, archiveDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs, maxLogs=32 2023-07-15 22:11:05,324 INFO [RS:0;jenkins-hbase4:45695] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45695%2C1689459063074, suffix=, logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45695,1689459063074, archiveDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs, maxLogs=32 2023-07-15 22:11:05,324 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:05,328 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 22:11:05,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:11:05,401 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK] 2023-07-15 22:11:05,410 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK] 2023-07-15 22:11:05,411 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK] 2023-07-15 22:11:05,413 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK] 2023-07-15 22:11:05,414 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK] 2023-07-15 22:11:05,414 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK] 2023-07-15 22:11:05,415 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK] 2023-07-15 22:11:05,416 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK] 2023-07-15 22:11:05,418 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK] 2023-07-15 22:11:05,458 INFO [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45299,1689459063195/jenkins-hbase4.apache.org%2C45299%2C1689459063195.1689459065329 2023-07-15 22:11:05,458 INFO [RS:0;jenkins-hbase4:45695] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45695,1689459063074/jenkins-hbase4.apache.org%2C45695%2C1689459063074.1689459065326 2023-07-15 22:11:05,470 DEBUG [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK], DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK]] 2023-07-15 22:11:05,474 INFO [RS:1;jenkins-hbase4:33297] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,33297,1689459063148/jenkins-hbase4.apache.org%2C33297%2C1689459063148.1689459065325 2023-07-15 22:11:05,474 DEBUG [RS:0;jenkins-hbase4:45695] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK], DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK]] 2023-07-15 22:11:05,480 DEBUG [RS:1;jenkins-hbase4:33297] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK], DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK]] 2023-07-15 22:11:05,598 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:05,602 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:05,608 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:05,637 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 22:11:05,637 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:05,644 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45299%2C1689459063195.meta, suffix=.meta, logDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45299,1689459063195, archiveDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs, maxLogs=32 2023-07-15 22:11:05,670 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK] 2023-07-15 22:11:05,675 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK] 2023-07-15 22:11:05,688 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK] 2023-07-15 22:11:05,736 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/WALs/jenkins-hbase4.apache.org,45299,1689459063195/jenkins-hbase4.apache.org%2C45299%2C1689459063195.meta.1689459065647.meta 2023-07-15 22:11:05,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40319,DS-dccf6fd1-ea10-4c70-ae66-9a2b5fed00ae,DISK], DatanodeInfoWithStorage[127.0.0.1:33375,DS-0b789b27-30bf-4f04-a2b5-06bc2d43486b,DISK], DatanodeInfoWithStorage[127.0.0.1:36719,DS-da20227d-0d4d-4fc7-bdf4-1017b216a321,DISK]] 2023-07-15 22:11:05,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:05,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 22:11:05,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:05,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 22:11:05,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 22:11:05,752 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 22:11:05,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 22:11:05,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:05,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 22:11:05,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 22:11:05,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 22:11:05,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/info 2023-07-15 22:11:05,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/info 2023-07-15 22:11:05,796 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 22:11:05,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 22:11:05,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:05,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:05,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 22:11:05,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 22:11:05,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/table 2023-07-15 22:11:05,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/table 2023-07-15 22:11:05,804 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 22:11:05,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740 2023-07-15 22:11:05,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740 2023-07-15 22:11:05,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 22:11:05,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 22:11:05,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62454688, jitterRate=-0.06935262680053711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 22:11:05,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 22:11:05,838 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689459065588 2023-07-15 22:11:05,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 22:11:05,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 22:11:05,860 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45299,1689459063195, state=OPEN 2023-07-15 22:11:05,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 22:11:05,864 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 22:11:05,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 22:11:05,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45299,1689459063195 in 526 msec 2023-07-15 22:11:05,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 22:11:05,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 774 msec 2023-07-15 22:11:05,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3450 sec 2023-07-15 22:11:05,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689459065884, completionTime=-1 2023-07-15 22:11:05,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 22:11:05,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 22:11:05,966 DEBUG [hconnection-0x73a83cd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:05,969 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:05,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 22:11:05,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689459125993 2023-07-15 22:11:05,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689459185993 2023-07-15 22:11:05,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 108 msec 2023-07-15 22:11:06,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41943,1689459061444-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41943,1689459061444-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41943,1689459061444-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41943, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,034 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 22:11:06,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 22:11:06,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:06,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 22:11:06,067 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:06,071 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:06,101 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,104 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529 empty. 2023-07-15 22:11:06,105 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,105 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 22:11:06,165 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:06,168 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d18205c94a8d73949a3f6cda81c1f529, NAME => 'hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d18205c94a8d73949a3f6cda81c1f529, disabling compactions & flushes 2023-07-15 22:11:06,205 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. after waiting 0 ms 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,205 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d18205c94a8d73949a3f6cda81c1f529: 2023-07-15 22:11:06,212 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:06,228 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459066215"}]},"ts":"1689459066215"} 2023-07-15 22:11:06,266 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 22:11:06,269 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:06,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459066269"}]},"ts":"1689459066269"} 2023-07-15 22:11:06,281 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 22:11:06,286 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:06,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:06,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:06,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:06,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:06,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d18205c94a8d73949a3f6cda81c1f529, ASSIGN}] 2023-07-15 22:11:06,295 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d18205c94a8d73949a3f6cda81c1f529, ASSIGN 2023-07-15 22:11:06,297 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d18205c94a8d73949a3f6cda81c1f529, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:11:06,450 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:11:06,451 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d18205c94a8d73949a3f6cda81c1f529, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:06,451 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459066451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459066451"}]},"ts":"1689459066451"} 2023-07-15 22:11:06,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d18205c94a8d73949a3f6cda81c1f529, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:11:06,611 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:06,612 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:06,615 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:06,622 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d18205c94a8d73949a3f6cda81c1f529, NAME => 'hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:06,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. service=AccessControlService 2023-07-15 22:11:06,623 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:06,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,630 INFO [StoreOpener-d18205c94a8d73949a3f6cda81c1f529-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,633 DEBUG [StoreOpener-d18205c94a8d73949a3f6cda81c1f529-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/info 2023-07-15 22:11:06,633 DEBUG [StoreOpener-d18205c94a8d73949a3f6cda81c1f529-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/info 2023-07-15 22:11:06,634 INFO [StoreOpener-d18205c94a8d73949a3f6cda81c1f529-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d18205c94a8d73949a3f6cda81c1f529 columnFamilyName info 2023-07-15 22:11:06,635 INFO [StoreOpener-d18205c94a8d73949a3f6cda81c1f529-1] regionserver.HStore(310): Store=d18205c94a8d73949a3f6cda81c1f529/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:06,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:11:06,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:06,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d18205c94a8d73949a3f6cda81c1f529; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72532323, jitterRate=0.08081583678722382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:06,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d18205c94a8d73949a3f6cda81c1f529: 2023-07-15 22:11:06,649 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529., pid=6, masterSystemTime=1689459066611 2023-07-15 22:11:06,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:11:06,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d18205c94a8d73949a3f6cda81c1f529, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:06,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066655"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459066655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459066655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459066655"}]},"ts":"1689459066655"} 2023-07-15 22:11:06,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 22:11:06,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d18205c94a8d73949a3f6cda81c1f529, server=jenkins-hbase4.apache.org,45695,1689459063074 in 204 msec 2023-07-15 22:11:06,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 22:11:06,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d18205c94a8d73949a3f6cda81c1f529, ASSIGN in 377 msec 2023-07-15 22:11:06,675 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:06,676 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459066676"}]},"ts":"1689459066676"} 2023-07-15 22:11:06,678 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 22:11:06,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:06,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 634 msec 2023-07-15 22:11:06,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 22:11:06,768 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:06,769 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:06,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:06,794 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:06,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 22:11:06,826 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:06,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-15 22:11:06,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 22:11:06,853 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:06,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-15 22:11:06,866 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 22:11:06,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 22:11:06,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.574sec 2023-07-15 22:11:06,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 22:11:06,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 22:11:06,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 22:11:06,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41943,1689459061444-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 22:11:06,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41943,1689459061444-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 22:11:06,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:06,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 22:11:06,904 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:06,905 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:06,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/acl/ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:06,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 22:11:06,909 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/acl/ded3f87c2067dd2a2293834e60744889 empty. 2023-07-15 22:11:06,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/acl/ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:06,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 22:11:06,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:06,934 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:06,936 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ded3f87c2067dd2a2293834e60744889, NAME => 'hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:06,951 DEBUG [Listener at localhost/36625] zookeeper.ReadOnlyZKClient(139): Connect 0x66ff428c to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:06,964 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,964 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ded3f87c2067dd2a2293834e60744889, disabling compactions & flushes 2023-07-15 22:11:06,965 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:06,965 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:06,965 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. after waiting 0 ms 2023-07-15 22:11:06,965 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:06,965 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:06,965 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ded3f87c2067dd2a2293834e60744889: 2023-07-15 22:11:06,966 DEBUG [Listener at localhost/36625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71c18574, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:06,971 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:06,973 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459066972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459066972"}]},"ts":"1689459066972"} 2023-07-15 22:11:06,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 22:11:06,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:06,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459066979"}]},"ts":"1689459066979"} 2023-07-15 22:11:06,985 DEBUG [hconnection-0x5f25882f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:06,988 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 22:11:06,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:06,996 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:06,996 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:06,996 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:06,996 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:06,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ded3f87c2067dd2a2293834e60744889, ASSIGN}] 2023-07-15 22:11:07,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ded3f87c2067dd2a2293834e60744889, ASSIGN 2023-07-15 22:11:07,005 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:07,006 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ded3f87c2067dd2a2293834e60744889, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689459063148; forceNewPlan=false, retain=false 2023-07-15 22:11:07,009 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:11:07,009 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 22:11:07,009 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/test.cache.data in system properties and HBase conf 2023-07-15 22:11:07,009 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop.log.dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:11:07,010 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/nfs.dump.dir in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 22:11:07,011 INFO [Listener at localhost/36625] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 22:11:07,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,157 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:11:07,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ded3f87c2067dd2a2293834e60744889, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:07,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459067158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459067158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459067158"}]},"ts":"1689459067158"} 2023-07-15 22:11:07,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ded3f87c2067dd2a2293834e60744889, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:11:07,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,328 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:07,328 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:07,333 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:07,340 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:07,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ded3f87c2067dd2a2293834e60744889, NAME => 'hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:07,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. service=AccessControlService 2023-07-15 22:11:07,341 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:07,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:07,342 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,342 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,348 INFO [StoreOpener-ded3f87c2067dd2a2293834e60744889-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,351 DEBUG [StoreOpener-ded3f87c2067dd2a2293834e60744889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/l 2023-07-15 22:11:07,351 DEBUG [StoreOpener-ded3f87c2067dd2a2293834e60744889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/l 2023-07-15 22:11:07,351 INFO [StoreOpener-ded3f87c2067dd2a2293834e60744889-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded3f87c2067dd2a2293834e60744889 columnFamilyName l 2023-07-15 22:11:07,353 INFO [StoreOpener-ded3f87c2067dd2a2293834e60744889-1] regionserver.HStore(310): Store=ded3f87c2067dd2a2293834e60744889/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:07,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ded3f87c2067dd2a2293834e60744889 2023-07-15 22:11:07,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:07,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ded3f87c2067dd2a2293834e60744889; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75362729, jitterRate=0.12299217283725739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:07,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ded3f87c2067dd2a2293834e60744889: 2023-07-15 22:11:07,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889., pid=11, masterSystemTime=1689459067328 2023-07-15 22:11:07,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:07,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:11:07,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ded3f87c2067dd2a2293834e60744889, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:07,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459067393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459067393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459067393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459067393"}]},"ts":"1689459067393"} 2023-07-15 22:11:07,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 22:11:07,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ded3f87c2067dd2a2293834e60744889, server=jenkins-hbase4.apache.org,33297,1689459063148 in 233 msec 2023-07-15 22:11:07,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 22:11:07,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ded3f87c2067dd2a2293834e60744889, ASSIGN in 405 msec 2023-07-15 22:11:07,406 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:07,407 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459067406"}]},"ts":"1689459067406"} 2023-07-15 22:11:07,409 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 22:11:07,412 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:07,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 512 msec 2023-07-15 22:11:07,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 22:11:07,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 22:11:08,420 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:08,724 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:08,729 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35389_jobhistory____.46g03p/webapp 2023-07-15 22:11:08,896 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 22:11:08,896 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:08,896 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:08,899 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:08,976 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:09,252 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:09,657 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 22:11:09,725 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35389 2023-07-15 22:11:11,363 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:11,675 WARN [Listener at jenkins-hbase4.apache.org/42499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:11,726 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 22:11:11,727 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 22:11:11,728 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 22:11:11,730 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,734 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 22:11:11,734 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,734 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 22:11:11,735 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 22:11:11,735 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 22:11:11,735 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,735 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 22:11:11,735 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 22:11:11,735 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 22:11:11,775 WARN [Listener at jenkins-hbase4.apache.org/42499] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:11,776 INFO [Listener at jenkins-hbase4.apache.org/42499] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:11,785 INFO [Listener at jenkins-hbase4.apache.org/42499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41323_cluster____yf8eul/webapp 2023-07-15 22:11:11,881 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:11,881 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 22:11:11,881 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:11,882 INFO [Listener at jenkins-hbase4.apache.org/42499] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:11,891 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,083 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,193 INFO [Listener at jenkins-hbase4.apache.org/42499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,201 INFO [Listener at jenkins-hbase4.apache.org/42499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41323 2023-07-15 22:11:12,741 WARN [Listener at jenkins-hbase4.apache.org/33263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:12,764 WARN [Listener at jenkins-hbase4.apache.org/33263] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:12,764 INFO [Listener at jenkins-hbase4.apache.org/33263] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:12,770 INFO [Listener at jenkins-hbase4.apache.org/33263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40779_node____.qrux5x/webapp 2023-07-15 22:11:12,824 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 22:11:12,824 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:12,824 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:12,824 INFO [Listener at jenkins-hbase4.apache.org/33263] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:12,831 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,850 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,965 INFO [Listener at jenkins-hbase4.apache.org/33263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,987 INFO [Listener at jenkins-hbase4.apache.org/33263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40779 2023-07-15 22:11:13,228 WARN [Listener at jenkins-hbase4.apache.org/34497] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:13,234 WARN [Listener at jenkins-hbase4.apache.org/34497] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:13,235 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:13,240 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44069_node____.k1s11r/webapp 2023-07-15 22:11:13,289 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 22:11:13,290 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:13,290 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:13,290 INFO [Listener at jenkins-hbase4.apache.org/34497] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:13,297 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:13,308 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:13,365 INFO [Listener at jenkins-hbase4.apache.org/34497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:13,369 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44069 2023-07-15 22:11:13,393 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 22:11:13,395 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:13,469 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=174, AvailableMemoryMB=4748 2023-07-15 22:11:13,469 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-15 22:11:13,486 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 22:11:13,492 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 22:11:13,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:11:13,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:13,506 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:13,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 22:11:13,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:13,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:13,516 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:13,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:13,517 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 empty. 2023-07-15 22:11:13,518 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d empty. 2023-07-15 22:11:13,519 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:13,519 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:13,520 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 22:11:13,565 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:13,567 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 20cf10418821bd1a97870b30bdc4d38d, NAME => 'testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:13,567 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e280d04d7f97479a55b56bddc4ebf0d8, NAME => 'testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:13,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:13,614 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:13,628 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 20cf10418821bd1a97870b30bdc4d38d, disabling compactions & flushes 2023-07-15 22:11:13,628 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:13,628 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:13,628 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. after waiting 0 ms 2023-07-15 22:11:13,628 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:13,628 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:13,628 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 20cf10418821bd1a97870b30bdc4d38d: 2023-07-15 22:11:13,636 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:13,637 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e280d04d7f97479a55b56bddc4ebf0d8, disabling compactions & flushes 2023-07-15 22:11:13,637 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:13,637 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:13,637 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. after waiting 0 ms 2023-07-15 22:11:13,637 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:13,637 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:13,637 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e280d04d7f97479a55b56bddc4ebf0d8: 2023-07-15 22:11:13,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:13,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459073644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459073644"}]},"ts":"1689459073644"} 2023-07-15 22:11:13,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459073644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459073644"}]},"ts":"1689459073644"} 2023-07-15 22:11:13,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:13,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:13,700 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459073700"}]},"ts":"1689459073700"} 2023-07-15 22:11:13,702 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 22:11:13,708 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:13,710 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:13,710 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:13,711 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:13,711 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:13,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, ASSIGN}] 2023-07-15 22:11:13,714 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, ASSIGN 2023-07-15 22:11:13,715 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, ASSIGN 2023-07-15 22:11:13,716 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:11:13,716 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:11:13,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:13,866 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:13,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20cf10418821bd1a97870b30bdc4d38d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:13,869 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e280d04d7f97479a55b56bddc4ebf0d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:13,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459073869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459073869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459073869"}]},"ts":"1689459073869"} 2023-07-15 22:11:13,869 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459073869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459073869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459073869"}]},"ts":"1689459073869"} 2023-07-15 22:11:13,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 20cf10418821bd1a97870b30bdc4d38d, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:11:13,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e280d04d7f97479a55b56bddc4ebf0d8, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:11:14,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e280d04d7f97479a55b56bddc4ebf0d8, NAME => 'testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:14,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. service=AccessControlService 2023-07-15 22:11:14,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:14,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20cf10418821bd1a97870b30bdc4d38d, NAME => 'testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. service=AccessControlService 2023-07-15 22:11:14,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:14,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:14,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,043 INFO [StoreOpener-e280d04d7f97479a55b56bddc4ebf0d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,043 INFO [StoreOpener-20cf10418821bd1a97870b30bdc4d38d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,049 DEBUG [StoreOpener-20cf10418821bd1a97870b30bdc4d38d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf 2023-07-15 22:11:14,049 DEBUG [StoreOpener-20cf10418821bd1a97870b30bdc4d38d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf 2023-07-15 22:11:14,054 INFO [StoreOpener-20cf10418821bd1a97870b30bdc4d38d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20cf10418821bd1a97870b30bdc4d38d columnFamilyName cf 2023-07-15 22:11:14,056 DEBUG [StoreOpener-e280d04d7f97479a55b56bddc4ebf0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf 2023-07-15 22:11:14,056 DEBUG [StoreOpener-e280d04d7f97479a55b56bddc4ebf0d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf 2023-07-15 22:11:14,057 INFO [StoreOpener-e280d04d7f97479a55b56bddc4ebf0d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e280d04d7f97479a55b56bddc4ebf0d8 columnFamilyName cf 2023-07-15 22:11:14,058 INFO [StoreOpener-20cf10418821bd1a97870b30bdc4d38d-1] regionserver.HStore(310): Store=20cf10418821bd1a97870b30bdc4d38d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:14,059 INFO [StoreOpener-e280d04d7f97479a55b56bddc4ebf0d8-1] regionserver.HStore(310): Store=e280d04d7f97479a55b56bddc4ebf0d8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:14,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:14,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:14,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:14,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:14,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e280d04d7f97479a55b56bddc4ebf0d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59771893, jitterRate=-0.10932938754558563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:14,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20cf10418821bd1a97870b30bdc4d38d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72944087, jitterRate=0.0869515985250473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:14,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e280d04d7f97479a55b56bddc4ebf0d8: 2023-07-15 22:11:14,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20cf10418821bd1a97870b30bdc4d38d: 2023-07-15 22:11:14,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d., pid=15, masterSystemTime=1689459074027 2023-07-15 22:11:14,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8., pid=16, masterSystemTime=1689459074028 2023-07-15 22:11:14,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:14,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:14,080 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20cf10418821bd1a97870b30bdc4d38d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,081 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459074080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459074080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459074080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459074080"}]},"ts":"1689459074080"} 2023-07-15 22:11:14,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:14,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:14,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e280d04d7f97479a55b56bddc4ebf0d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,085 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459074081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459074081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459074081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459074081"}]},"ts":"1689459074081"} 2023-07-15 22:11:14,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-15 22:11:14,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 20cf10418821bd1a97870b30bdc4d38d, server=jenkins-hbase4.apache.org,45299,1689459063195 in 215 msec 2023-07-15 22:11:14,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-15 22:11:14,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e280d04d7f97479a55b56bddc4ebf0d8, server=jenkins-hbase4.apache.org,45695,1689459063074 in 213 msec 2023-07-15 22:11:14,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, ASSIGN in 380 msec 2023-07-15 22:11:14,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 22:11:14,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, ASSIGN in 382 msec 2023-07-15 22:11:14,098 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:14,098 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459074098"}]},"ts":"1689459074098"} 2023-07-15 22:11:14,099 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 22:11:14,104 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:14,108 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 22:11:14,114 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,117 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,132 DEBUG [hconnection-0x6c11e447-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:14,135 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,144 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:14,179 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:14,179 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:14,179 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:14,179 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:14,179 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:14,188 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:14,189 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:14,189 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:14,189 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:14,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:14,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 690 msec 2023-07-15 22:11:14,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:14,635 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 22:11:14,640 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 22:11:14,641 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:14,643 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:14,675 DEBUG [hconnection-0x5f25882f-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,685 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:14,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459074705 (current time:1689459074705). 2023-07-15 22:11:14,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:14,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x62057f21 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:14,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382ab212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:14,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,718 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62057f21 to 127.0.0.1:53851 2023-07-15 22:11:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:14,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x3f9dc66b to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a2ecf83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:14,827 DEBUG [hconnection-0x6ef24754-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,829 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:14,837 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:14,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f9dc66b to 127.0.0.1:53851 2023-07-15 22:11:14,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:14,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:14,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:14,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:14,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:14,892 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:14,894 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689459674894 2023-07-15 22:11:14,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:14,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 22:11:14,898 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:14,902 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:14,902 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:14,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:14,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-15 22:11:14,905 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:14,909 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689459674909 2023-07-15 22:11:14,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,936 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 22:11:14,937 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:14,938 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 22:11:14,938 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 22:11:14,939 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,939 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,945 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,945 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,945 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,945 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,947 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,947 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,948 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,949 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:14,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,954 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:14,954 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:14,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:14,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:14,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,956 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:14,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,957 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:14,957 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:14,958 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:14,958 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:14,958 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:14,958 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:14,958 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:14,959 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,960 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,960 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,961 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,961 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,962 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,962 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,963 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,964 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:14,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,968 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,968 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:14,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:14,970 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 22:11:14,970 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,975 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,975 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,975 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:14,975 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:14,975 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:14,975 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:14,976 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:14,976 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:14,976 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:14,976 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:14,976 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:14,976 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:14,976 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. started... 2023-07-15 22:11:14,976 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. started... 2023-07-15 22:11:14,978 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:14,978 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:14,978 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:14,981 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20cf10418821bd1a97870b30bdc4d38d: 2023-07-15 22:11:14,981 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e280d04d7f97479a55b56bddc4ebf0d8: 2023-07-15 22:11:14,982 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,982 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:14,987 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:14,987 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:14,991 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:14,991 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:15,002 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:15,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:15,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:15,016 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:15,022 WARN [DataStreamer for file /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/region-manifest.e280d04d7f97479a55b56bddc4ebf0d8] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-15 22:11:15,023 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. completed. 2023-07-15 22:11:15,023 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:15,023 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. completed. 2023-07-15 22:11:15,023 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,024 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:15,024 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:15,024 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:15,024 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:15,026 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:15,026 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,026 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:15,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,026 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,026 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:15,031 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:15,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:15,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:15,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:15,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:15,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:11:15,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 22:11:15,041 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 22:11:15,041 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:15,041 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:15,041 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,041 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,048 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:15,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,049 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,050 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:15,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,053 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:15,053 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,054 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,070 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,070 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,070 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,070 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,070 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:15,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,071 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:15,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 22:11:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,071 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,072 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,073 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,073 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,073 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,073 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,073 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:15,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:15,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:11:15,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,217 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:15,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:15,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:15,219 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:11:15,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 22:11:15,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,304 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:15,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689459074894Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689459075090 (+196 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689459075090Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689459075090Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689459075106 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689459075180 (+74 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689459075303 (+123 ms) 2023-07-15 22:11:15,307 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:15,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 411 msec 2023-07-15 22:11:15,519 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:15,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:15,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:15,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45299] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:15,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45695] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:15,548 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 22:11:15,548 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:15,549 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:15,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:15,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459075576 (current time:1689459075576). 2023-07-15 22:11:15,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:15,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x670caadd to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:15,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10338d15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:15,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:15,594 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:15,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x670caadd to 127.0.0.1:53851 2023-07-15 22:11:15,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:15,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x3a1d8b60 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:15,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38c594bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:15,612 DEBUG [hconnection-0x3412fd94-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:15,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:15,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:15,624 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a1d8b60 to 127.0.0.1:53851 2023-07-15 22:11:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:15,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:15,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:15,631 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:15,633 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689459675633 2023-07-15 22:11:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:15,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 22:11:15,634 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:15,635 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:15,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:15,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:15,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-15 22:11:15,644 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:15,649 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689459675649 2023-07-15 22:11:15,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 22:11:15,722 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 22:11:15,722 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:15,724 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 22:11:15,724 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 22:11:15,724 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,724 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,726 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,726 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:15,726 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,727 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,729 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:15,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:15,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:15,731 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:15,731 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:15,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:15,736 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:15,736 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:15,736 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:15,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:15,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:15,742 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:15,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:15,747 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:15,747 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:15,747 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:15,750 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,751 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:15,753 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,753 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:15,753 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,753 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:15,753 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,754 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,754 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:15,754 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,754 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:15,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:15,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:15,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:15,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:15,764 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 22:11:15,764 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:15,770 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:15,770 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:15,770 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:15,771 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:15,771 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:15,771 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. started... 2023-07-15 22:11:15,771 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. started... 2023-07-15 22:11:15,771 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20cf10418821bd1a97870b30bdc4d38d 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-15 22:11:15,771 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e280d04d7f97479a55b56bddc4ebf0d8 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-15 22:11:15,778 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:15,778 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:15,942 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:15,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:15,944 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:11:15,979 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9 2023-07-15 22:11:15,979 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508 2023-07-15 22:11:16,018 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/.tmp/cf/9b9b153ed07f4a96a23a33de82ffbeb5 2023-07-15 22:11:16,030 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/.tmp/cf/a1ed51b1678b4a3db210e8b01f774627 2023-07-15 22:11:16,034 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/.tmp/cf/9b9b153ed07f4a96a23a33de82ffbeb5 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5 2023-07-15 22:11:16,044 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/.tmp/cf/a1ed51b1678b4a3db210e8b01f774627 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627 2023-07-15 22:11:16,046 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5, entries=7, sequenceid=6, filesize=6.1 K 2023-07-15 22:11:16,051 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 20cf10418821bd1a97870b30bdc4d38d in 279ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:16,051 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 22:11:16,052 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20cf10418821bd1a97870b30bdc4d38d: 2023-07-15 22:11:16,052 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:16,052 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:16,052 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5] hfiles 2023-07-15 22:11:16,052 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:16,055 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627, entries=43, sequenceid=6, filesize=12.1 K 2023-07-15 22:11:16,058 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for e280d04d7f97479a55b56bddc4ebf0d8 in 287ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:16,060 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e280d04d7f97479a55b56bddc4ebf0d8: 2023-07-15 22:11:16,060 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:16,060 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:16,060 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627] hfiles 2023-07-15 22:11:16,060 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:16,244 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:16,246 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 22:11:16,500 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. completed. 2023-07-15 22:11:16,500 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:16,500 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. completed. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,500 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:16,500 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:16,502 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:16,502 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,502 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:16,502 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:16,504 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:16,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:11:16,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 22:11:16,514 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 22:11:16,514 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:16,514 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:16,514 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 22:11:16,514 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,516 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:16,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:16,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:16,517 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,518 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:16,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,520 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:16,521 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:16,521 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:16,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:16,532 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:16,533 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:16,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 22:11:16,533 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:16,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-15 22:11:16,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:16,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:16,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 22:11:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:16,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:16,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,534 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:16,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9] mob files 2023-07-15 22:11:16,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508 2023-07-15 22:11:16,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9 2023-07-15 22:11:16,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 22:11:16,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 22:11:16,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,632 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:16,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689459075634Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689459076554 (+920 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689459076554Loading Region manifests for snaptb0-testExportWithTargetName at 1689459076554Writing data manifest for snaptb0-testExportWithTargetName at 1689459076562 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689459076585 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689459076632 (+47 ms) 2023-07-15 22:11:16,634 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:16,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0000 sec 2023-07-15 22:11:16,746 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:16,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:16,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:16,751 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751 2023-07-15 22:11:16,752 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38251, tgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751, rawTgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:16,801 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:16,802 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-121670248_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 22:11:16,802 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 22:11:16,825 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 22:11:16,894 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,895 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,895 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,896 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,896 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,897 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,897 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,985 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-7462802046580254431.jar 2023-07-15 22:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,987 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,987 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,988 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,989 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,990 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:16,990 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:16,991 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:16,992 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:16,993 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:16,993 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:16,994 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:16,995 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:16,995 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:16,996 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:16,997 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:17,001 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:17,002 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:17,002 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:17,003 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:17,003 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:17,004 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:17,004 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:17,930 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:17,937 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 22:11:17,947 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 22:11:18,498 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:18,499 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:19,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:19,558 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:24,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:26,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:30,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:31,930 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:11:31,932 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:11:31,944 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 22:11:31,944 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:11:31,945 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:11:31,945 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 22:11:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 22:11:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 22:11:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/testExportWithTargetName 2023-07-15 22:11:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 22:11:31,947 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459076751/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 22:11:31,965 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 22:11:31,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 22:11:31,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:31,994 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459091994"}]},"ts":"1689459091994"} 2023-07-15 22:11:31,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:31,996 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 22:11:32,072 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 22:11:32,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, UNASSIGN}] 2023-07-15 22:11:32,078 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, UNASSIGN 2023-07-15 22:11:32,079 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, UNASSIGN 2023-07-15 22:11:32,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20cf10418821bd1a97870b30bdc4d38d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:32,080 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e280d04d7f97479a55b56bddc4ebf0d8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:32,080 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459092080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459092080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459092080"}]},"ts":"1689459092080"} 2023-07-15 22:11:32,080 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459092080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459092080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459092080"}]},"ts":"1689459092080"} 2023-07-15 22:11:32,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 20cf10418821bd1a97870b30bdc4d38d, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:11:32,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure e280d04d7f97479a55b56bddc4ebf0d8, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:11:32,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:32,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:32,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20cf10418821bd1a97870b30bdc4d38d, disabling compactions & flushes 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e280d04d7f97479a55b56bddc4ebf0d8, disabling compactions & flushes 2023-07-15 22:11:32,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:32,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. after waiting 0 ms 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. after waiting 0 ms 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:32,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:32,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:32,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:32,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:32,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d. 2023-07-15 22:11:32,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20cf10418821bd1a97870b30bdc4d38d: 2023-07-15 22:11:32,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:32,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8. 2023-07-15 22:11:32,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e280d04d7f97479a55b56bddc4ebf0d8: 2023-07-15 22:11:32,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:32,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20cf10418821bd1a97870b30bdc4d38d, regionState=CLOSED 2023-07-15 22:11:32,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459092291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459092291"}]},"ts":"1689459092291"} 2023-07-15 22:11:32,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:32,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e280d04d7f97479a55b56bddc4ebf0d8, regionState=CLOSED 2023-07-15 22:11:32,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459092292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459092292"}]},"ts":"1689459092292"} 2023-07-15 22:11:32,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:32,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 22:11:32,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 22:11:32,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 20cf10418821bd1a97870b30bdc4d38d, server=jenkins-hbase4.apache.org,45299,1689459063195 in 211 msec 2023-07-15 22:11:32,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure e280d04d7f97479a55b56bddc4ebf0d8, server=jenkins-hbase4.apache.org,45695,1689459063074 in 206 msec 2023-07-15 22:11:32,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20cf10418821bd1a97870b30bdc4d38d, UNASSIGN in 225 msec 2023-07-15 22:11:32,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-15 22:11:32,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e280d04d7f97479a55b56bddc4ebf0d8, UNASSIGN in 225 msec 2023-07-15 22:11:32,303 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459092303"}]},"ts":"1689459092303"} 2023-07-15 22:11:32,305 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 22:11:32,372 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 22:11:32,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 398 msec 2023-07-15 22:11:32,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:32,600 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 22:11:32,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 22:11:32,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,614 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 22:11:32,616 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,619 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 22:11:32,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:32,622 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:32,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/recovered.edits] 2023-07-15 22:11:32,626 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/recovered.edits] 2023-07-15 22:11:32,634 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/cf/9b9b153ed07f4a96a23a33de82ffbeb5 2023-07-15 22:11:32,634 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/cf/a1ed51b1678b4a3db210e8b01f774627 2023-07-15 22:11:32,639 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d/recovered.edits/9.seqid 2023-07-15 22:11:32,639 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8/recovered.edits/9.seqid 2023-07-15 22:11:32,640 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/20cf10418821bd1a97870b30bdc4d38d 2023-07-15 22:11:32,640 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportWithTargetName/e280d04d7f97479a55b56bddc4ebf0d8 2023-07-15 22:11:32,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 22:11:32,640 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 22:11:32,641 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-15 22:11:32,645 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715bdeb72f39d1c4311a017d989a28dd508 2023-07-15 22:11:32,647 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307151a7ed61256904ebca3620f3a3683dbb9 2023-07-15 22:11:32,647 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 22:11:32,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,672 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 22:11:32,675 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 22:11:32,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 22:11:32,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459092677"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:32,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459092677"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:32,681 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:11:32,681 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 20cf10418821bd1a97870b30bdc4d38d, NAME => 'testtb-testExportWithTargetName,,1689459073499.20cf10418821bd1a97870b30bdc4d38d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e280d04d7f97479a55b56bddc4ebf0d8, NAME => 'testtb-testExportWithTargetName,1,1689459073499.e280d04d7f97479a55b56bddc4ebf0d8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:11:32,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 22:11:32,681 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459092681"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:32,683 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 22:11:32,720 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:32,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 114 msec 2023-07-15 22:11:32,780 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,780 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,780 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,780 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 22:11:32,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 22:11:32,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 22:11:32,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:32,835 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:32,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 22:11:32,839 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 22:11:32,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 22:11:32,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:32,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 22:11:32,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 22:11:32,893 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:44660 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:55576 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:36426 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:34497 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:36825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:37785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1992516234_1 at /127.0.0.1:41150 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=943 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3042 (was 4748) 2023-07-15 22:11:32,894 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-15 22:11:32,917 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=943, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=180, AvailableMemoryMB=3042 2023-07-15 22:11:32,917 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-15 22:11:32,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:11:32,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:32,923 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:32,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 22:11:32,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:32,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:32,928 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:32,928 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:32,929 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 empty. 2023-07-15 22:11:32,929 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 empty. 2023-07-15 22:11:32,930 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:32,930 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:32,930 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 22:11:32,942 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:32,943 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 376833188c6ada3838a4bc9a6ee438c5, NAME => 'testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:32,944 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9377d1c8387720272e22ade3d8817694, NAME => 'testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:32,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 376833188c6ada3838a4bc9a6ee438c5, disabling compactions & flushes 2023-07-15 22:11:32,959 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. after waiting 0 ms 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:32,959 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 376833188c6ada3838a4bc9a6ee438c5: 2023-07-15 22:11:32,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:32,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9377d1c8387720272e22ade3d8817694, disabling compactions & flushes 2023-07-15 22:11:32,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:32,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:32,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. after waiting 0 ms 2023-07-15 22:11:32,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:32,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:32,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9377d1c8387720272e22ade3d8817694: 2023-07-15 22:11:32,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:32,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459092964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459092964"}]},"ts":"1689459092964"} 2023-07-15 22:11:32,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459092964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459092964"}]},"ts":"1689459092964"} 2023-07-15 22:11:32,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:32,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:32,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459092967"}]},"ts":"1689459092967"} 2023-07-15 22:11:32,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 22:11:33,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:33,041 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:33,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:33,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:33,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:33,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:33,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, ASSIGN}] 2023-07-15 22:11:33,047 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, ASSIGN 2023-07-15 22:11:33,047 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, ASSIGN 2023-07-15 22:11:33,048 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:11:33,048 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689459063148; forceNewPlan=false, retain=false 2023-07-15 22:11:33,198 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:33,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=376833188c6ada3838a4bc9a6ee438c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9377d1c8387720272e22ade3d8817694, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459093201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459093201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459093201"}]},"ts":"1689459093201"} 2023-07-15 22:11:33,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459093201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459093201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459093201"}]},"ts":"1689459093201"} 2023-07-15 22:11:33,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 376833188c6ada3838a4bc9a6ee438c5, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:11:33,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 9377d1c8387720272e22ade3d8817694, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:11:33,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:33,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9377d1c8387720272e22ade3d8817694, NAME => 'testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:33,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 376833188c6ada3838a4bc9a6ee438c5, NAME => 'testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:33,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. service=AccessControlService 2023-07-15 22:11:33,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. service=AccessControlService 2023-07-15 22:11:33,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,367 INFO [StoreOpener-9377d1c8387720272e22ade3d8817694-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,368 INFO [StoreOpener-376833188c6ada3838a4bc9a6ee438c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,369 DEBUG [StoreOpener-9377d1c8387720272e22ade3d8817694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf 2023-07-15 22:11:33,369 DEBUG [StoreOpener-9377d1c8387720272e22ade3d8817694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf 2023-07-15 22:11:33,369 DEBUG [StoreOpener-376833188c6ada3838a4bc9a6ee438c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf 2023-07-15 22:11:33,369 DEBUG [StoreOpener-376833188c6ada3838a4bc9a6ee438c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf 2023-07-15 22:11:33,370 INFO [StoreOpener-376833188c6ada3838a4bc9a6ee438c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 376833188c6ada3838a4bc9a6ee438c5 columnFamilyName cf 2023-07-15 22:11:33,370 INFO [StoreOpener-9377d1c8387720272e22ade3d8817694-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9377d1c8387720272e22ade3d8817694 columnFamilyName cf 2023-07-15 22:11:33,371 INFO [StoreOpener-9377d1c8387720272e22ade3d8817694-1] regionserver.HStore(310): Store=9377d1c8387720272e22ade3d8817694/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:33,371 INFO [StoreOpener-376833188c6ada3838a4bc9a6ee438c5-1] regionserver.HStore(310): Store=376833188c6ada3838a4bc9a6ee438c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:33,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:33,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:33,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:33,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9377d1c8387720272e22ade3d8817694; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70632094, jitterRate=0.05250021815299988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:33,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9377d1c8387720272e22ade3d8817694: 2023-07-15 22:11:33,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694., pid=31, masterSystemTime=1689459093359 2023-07-15 22:11:33,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,384 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9377d1c8387720272e22ade3d8817694, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,384 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459093384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459093384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459093384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459093384"}]},"ts":"1689459093384"} 2023-07-15 22:11:33,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:33,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 376833188c6ada3838a4bc9a6ee438c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61794598, jitterRate=-0.07918873429298401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:33,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 376833188c6ada3838a4bc9a6ee438c5: 2023-07-15 22:11:33,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5., pid=30, masterSystemTime=1689459093357 2023-07-15 22:11:33,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=376833188c6ada3838a4bc9a6ee438c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,394 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459093390"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459093390"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459093390"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459093390"}]},"ts":"1689459093390"} 2023-07-15 22:11:33,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-15 22:11:33,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 9377d1c8387720272e22ade3d8817694, server=jenkins-hbase4.apache.org,45299,1689459063195 in 182 msec 2023-07-15 22:11:33,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, ASSIGN in 351 msec 2023-07-15 22:11:33,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-15 22:11:33,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 376833188c6ada3838a4bc9a6ee438c5, server=jenkins-hbase4.apache.org,33297,1689459063148 in 192 msec 2023-07-15 22:11:33,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 22:11:33,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, ASSIGN in 355 msec 2023-07-15 22:11:33,402 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:33,402 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459093402"}]},"ts":"1689459093402"} 2023-07-15 22:11:33,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 22:11:33,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:33,428 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 22:11:33,430 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:33,434 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:33,434 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:33,434 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:33,434 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:33,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:33,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:33,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:33,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:33,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 522 msec 2023-07-15 22:11:33,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:33,531 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 22:11:33,534 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 22:11:33,534 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,536 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:33,545 DEBUG [hconnection-0x5f25882f-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,552 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459093558 (current time:1689459093558). 2023-07-15 22:11:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:33,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x098e82e6 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:33,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b5451f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:33,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,569 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x098e82e6 to 127.0.0.1:53851 2023-07-15 22:11:33,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:33,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x405d90c6 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:33,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d39b399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:33,579 DEBUG [hconnection-0x178e849c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,582 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,587 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x405d90c6 to 127.0.0.1:53851 2023-07-15 22:11:33,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:33,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,594 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,595 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459693595 2023-07-15 22:11:33,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 22:11:33,596 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:33,597 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:33,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:33,600 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-15 22:11:33,603 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:33,604 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459693604 2023-07-15 22:11:33,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,628 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 22:11:33,628 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,630 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 22:11:33,630 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:11:33,631 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,631 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,632 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,633 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,633 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,634 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,635 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,635 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,635 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,635 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,645 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,645 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,643 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,645 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,645 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,656 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,656 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,656 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,656 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56626fc[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:33,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56626fc[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:33,662 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:11:33,662 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,663 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,663 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,664 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:33,664 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,664 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,665 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. started... 2023-07-15 22:11:33,665 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. started... 2023-07-15 22:11:33,664 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,665 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 376833188c6ada3838a4bc9a6ee438c5: 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9377d1c8387720272e22ade3d8817694: 2023-07-15 22:11:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:33,667 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:33,669 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:33,692 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. completed. 2023-07-15 22:11:33,692 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,692 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,693 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. completed. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:33,693 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:33,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:33,696 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:33,697 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:33,697 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:33,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:33,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,699 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:11:33,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:11:33,706 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 22:11:33,706 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:33,706 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:33,706 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,706 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,709 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,709 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,710 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,712 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,712 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,712 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,715 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,715 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,715 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,715 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,716 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:33,716 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,716 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,715 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,716 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:33,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 22:11:33,717 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,718 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:11:33,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 22:11:33,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,785 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:33,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689459093595Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689459093729 (+134 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689459093729Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689459093729Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689459093735 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689459093746 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689459093785 (+39 ms) 2023-07-15 22:11:33,788 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:33,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 192 msec 2023-07-15 22:11:33,900 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:33,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:33,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:33,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:33,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45299] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:33,910 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 22:11:33,910 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,910 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:33,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459093922 (current time:1689459093922). 2023-07-15 22:11:33,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:33,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x5140ad9a to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:33,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61f2a816, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:33,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,933 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5140ad9a to 127.0.0.1:53851 2023-07-15 22:11:33,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:33,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x3fcc424d to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:33,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ff2b32b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:33,943 DEBUG [hconnection-0x75b3140b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,944 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:33,950 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:33,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fcc424d to 127.0.0.1:53851 2023-07-15 22:11:33,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:33,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,955 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,956 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459693956 2023-07-15 22:11:33,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 22:11:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:33,958 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:33,958 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:33,959 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:33,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:33,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-15 22:11:33,961 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:33,962 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459693962 2023-07-15 22:11:33,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 22:11:33,973 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 22:11:33,973 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,974 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 22:11:33,974 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:11:33,975 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,975 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,976 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,976 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,976 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,976 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,977 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:33,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:33,979 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,979 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:33,983 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,983 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,983 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:33,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:33,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:33,987 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:11:33,988 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:33,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:33,990 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,990 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:33,990 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:33,990 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:33,990 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:33,990 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:33,991 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:33,991 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:33,991 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:33,991 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:33,991 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. started... 2023-07-15 22:11:33,991 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:33,991 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:33,991 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. started... 2023-07-15 22:11:33,991 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9377d1c8387720272e22ade3d8817694 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 22:11:33,991 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 376833188c6ada3838a4bc9a6ee438c5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 22:11:33,992 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:33,992 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:33,992 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:34,015 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2 2023-07-15 22:11:34,021 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572 2023-07-15 22:11:34,031 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/.tmp/cf/12eb009c4b2640b3874b70f4e6970c51 2023-07-15 22:11:34,037 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/.tmp/cf/12eb009c4b2640b3874b70f4e6970c51 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51 2023-07-15 22:11:34,041 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/.tmp/cf/37a007bafb1f44fb9b80a58f6b2c98e9 2023-07-15 22:11:34,045 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 22:11:34,047 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 376833188c6ada3838a4bc9a6ee438c5 in 56ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:34,047 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 22:11:34,047 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 376833188c6ada3838a4bc9a6ee438c5: 2023-07-15 22:11:34,047 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:34,047 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:34,048 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51] hfiles 2023-07-15 22:11:34,048 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:34,050 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/.tmp/cf/37a007bafb1f44fb9b80a58f6b2c98e9 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9 2023-07-15 22:11:34,056 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9, entries=47, sequenceid=6, filesize=12.8 K 2023-07-15 22:11:34,057 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9377d1c8387720272e22ade3d8817694 in 66ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:34,058 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:34,060 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9377d1c8387720272e22ade3d8817694: 2023-07-15 22:11:34,060 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:34,060 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:34,060 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9] hfiles 2023-07-15 22:11:34,060 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:34,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:34,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:34,061 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:34,063 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. completed. 2023-07-15 22:11:34,063 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:34,068 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:34,068 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,068 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:34,068 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,072 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. completed. 2023-07-15 22:11:34,072 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:34,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:34,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:34,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,075 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:34,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:11:34,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:11:34,081 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 22:11:34,081 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:34,081 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:34,081 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 22:11:34,081 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:34,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:34,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:34,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:34,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,085 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,085 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:34,086 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,087 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,087 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,088 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:34,089 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,089 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:34,094 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:34,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:34,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,096 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 22:11:34,096 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:34,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 22:11:34,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:34,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:34,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2] mob files 2023-07-15 22:11:34,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572 2023-07-15 22:11:34,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2 2023-07-15 22:11:34,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 22:11:34,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,261 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:34,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:34,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:34,263 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:11:34,563 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:34,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:34,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:34,564 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 22:11:34,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 22:11:34,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,617 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:34,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689459093957Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689459094124 (+167 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689459094124Loading Region manifests for snaptb0-testExportFileSystemState at 1689459094124Writing data manifest for snaptb0-testExportFileSystemState at 1689459094136 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689459094579 (+443 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689459094616 (+37 ms) 2023-07-15 22:11:34,620 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:34,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 663 msec 2023-07-15 22:11:35,065 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:35,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:35,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:35,066 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066 2023-07-15 22:11:35,066 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38251, tgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066, rawTgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:35,094 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:35,094 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_999697425_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:35,094 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 22:11:35,108 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:35,137 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,138 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,138 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,138 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,139 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,139 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,139 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,241 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-2054290516433904022.jar 2023-07-15 22:11:35,241 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,243 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,243 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:35,243 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:35,244 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:35,244 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:35,245 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:35,245 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:35,245 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:35,246 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:35,246 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:35,246 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:35,247 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:35,247 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:35,248 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:35,248 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:35,248 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:35,249 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:35,249 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:35,250 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:36,258 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:36,324 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:36,330 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 22:11:36,333 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 22:11:36,444 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:36,444 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:36,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:37,898 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:41,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:43,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:46,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:47,595 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:11:47,596 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:11:47,605 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 22:11:47,605 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:11:47,606 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 22:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 22:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:47,607 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 22:11:47,607 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459095066/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 22:11:47,615 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 22:11:47,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 22:11:47,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:47,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459107622"}]},"ts":"1689459107622"} 2023-07-15 22:11:47,624 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 22:11:47,626 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 22:11:47,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, UNASSIGN}] 2023-07-15 22:11:47,629 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, UNASSIGN 2023-07-15 22:11:47,630 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, UNASSIGN 2023-07-15 22:11:47,631 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=376833188c6ada3838a4bc9a6ee438c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:47,631 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9377d1c8387720272e22ade3d8817694, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:47,631 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459107631"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459107631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459107631"}]},"ts":"1689459107631"} 2023-07-15 22:11:47,631 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459107631"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459107631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459107631"}]},"ts":"1689459107631"} 2023-07-15 22:11:47,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 376833188c6ada3838a4bc9a6ee438c5, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:11:47,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 9377d1c8387720272e22ade3d8817694, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:11:47,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:47,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 376833188c6ada3838a4bc9a6ee438c5, disabling compactions & flushes 2023-07-15 22:11:47,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. after waiting 0 ms 2023-07-15 22:11:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:47,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:47,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9377d1c8387720272e22ade3d8817694, disabling compactions & flushes 2023-07-15 22:11:47,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:47,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:47,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. after waiting 0 ms 2023-07-15 22:11:47,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:47,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:47,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:47,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:47,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:47,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694. 2023-07-15 22:11:47,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9377d1c8387720272e22ade3d8817694: 2023-07-15 22:11:47,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5. 2023-07-15 22:11:47,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 376833188c6ada3838a4bc9a6ee438c5: 2023-07-15 22:11:47,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:47,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=376833188c6ada3838a4bc9a6ee438c5, regionState=CLOSED 2023-07-15 22:11:47,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459107808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459107808"}]},"ts":"1689459107808"} 2023-07-15 22:11:47,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:47,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9377d1c8387720272e22ade3d8817694, regionState=CLOSED 2023-07-15 22:11:47,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459107809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459107809"}]},"ts":"1689459107809"} 2023-07-15 22:11:47,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-15 22:11:47,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-15 22:11:47,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 376833188c6ada3838a4bc9a6ee438c5, server=jenkins-hbase4.apache.org,33297,1689459063148 in 177 msec 2023-07-15 22:11:47,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 9377d1c8387720272e22ade3d8817694, server=jenkins-hbase4.apache.org,45299,1689459063195 in 177 msec 2023-07-15 22:11:47,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9377d1c8387720272e22ade3d8817694, UNASSIGN in 190 msec 2023-07-15 22:11:47,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 22:11:47,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=376833188c6ada3838a4bc9a6ee438c5, UNASSIGN in 190 msec 2023-07-15 22:11:47,820 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459107820"}]},"ts":"1689459107820"} 2023-07-15 22:11:47,822 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 22:11:47,824 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 22:11:47,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-15 22:11:47,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:47,924 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 22:11:47,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 22:11:47,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,929 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 22:11:47,930 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,931 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 22:11:47,935 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:47,935 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:47,937 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/recovered.edits] 2023-07-15 22:11:47,937 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/recovered.edits] 2023-07-15 22:11:47,938 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,938 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,939 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,938 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 22:11:47,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 22:11:47,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 22:11:47,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:47,940 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:47,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 22:11:47,943 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/cf/12eb009c4b2640b3874b70f4e6970c51 2023-07-15 22:11:47,943 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/cf/37a007bafb1f44fb9b80a58f6b2c98e9 2023-07-15 22:11:47,946 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5/recovered.edits/9.seqid 2023-07-15 22:11:47,946 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694/recovered.edits/9.seqid 2023-07-15 22:11:47,947 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/376833188c6ada3838a4bc9a6ee438c5 2023-07-15 22:11:47,947 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemState/9377d1c8387720272e22ade3d8817694 2023-07-15 22:11:47,947 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 22:11:47,947 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 22:11:47,948 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-15 22:11:47,951 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307159339bf74ef334d0fa0224ecf3ec4c572 2023-07-15 22:11:47,952 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715ae7940ccf8644e4080f092b15c0893e2 2023-07-15 22:11:47,952 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 22:11:47,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,957 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 22:11:47,959 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 22:11:47,960 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,960 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 22:11:47,960 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459107960"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:47,960 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459107960"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:47,962 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:11:47,962 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 376833188c6ada3838a4bc9a6ee438c5, NAME => 'testtb-testExportFileSystemState,,1689459092919.376833188c6ada3838a4bc9a6ee438c5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9377d1c8387720272e22ade3d8817694, NAME => 'testtb-testExportFileSystemState,1,1689459092919.9377d1c8387720272e22ade3d8817694.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:11:47,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 22:11:47,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459107962"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:47,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 22:11:47,966 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:47,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-15 22:11:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 22:11:48,043 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 22:11:48,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 22:11:48,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:48,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 22:11:48,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 22:11:48,082 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 755) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1351098279_1 at /127.0.0.1:36620 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:43131 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1351098279_1 at /127.0.0.1:39022 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2142 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:43676 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:36652 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:39046 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 943), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 292) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=2836 (was 3042) 2023-07-15 22:11:48,082 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-15 22:11:48,103 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=180, AvailableMemoryMB=2836 2023-07-15 22:11:48,103 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-15 22:11:48,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:11:48,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:11:48,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:48,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 22:11:48,112 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:48,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:48,115 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,116 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 empty. 2023-07-15 22:11:48,116 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,116 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,117 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb empty. 2023-07-15 22:11:48,117 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 22:11:48,128 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:48,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4b53b8853a8aaefd33dabaffd220d01, NAME => 'testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:48,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5cad4b4a89d4e49b870f807f86ade9cb, NAME => 'testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5cad4b4a89d4e49b870f807f86ade9cb, disabling compactions & flushes 2023-07-15 22:11:48,152 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. after waiting 0 ms 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,152 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,152 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5cad4b4a89d4e49b870f807f86ade9cb: 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing e4b53b8853a8aaefd33dabaffd220d01, disabling compactions & flushes 2023-07-15 22:11:48,153 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. after waiting 0 ms 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,153 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for e4b53b8853a8aaefd33dabaffd220d01: 2023-07-15 22:11:48,155 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:48,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459108156"}]},"ts":"1689459108156"} 2023-07-15 22:11:48,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459108156"}]},"ts":"1689459108156"} 2023-07-15 22:11:48,159 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:48,159 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:48,160 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459108159"}]},"ts":"1689459108159"} 2023-07-15 22:11:48,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 22:11:48,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:48,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:48,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:48,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:48,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:48,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, ASSIGN}] 2023-07-15 22:11:48,171 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, ASSIGN 2023-07-15 22:11:48,171 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, ASSIGN 2023-07-15 22:11:48,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689459063148; forceNewPlan=false, retain=false 2023-07-15 22:11:48,172 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:11:48,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:48,322 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:48,325 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5cad4b4a89d4e49b870f807f86ade9cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e4b53b8853a8aaefd33dabaffd220d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459108325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459108325"}]},"ts":"1689459108325"} 2023-07-15 22:11:48,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459108325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459108325"}]},"ts":"1689459108325"} 2023-07-15 22:11:48,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 5cad4b4a89d4e49b870f807f86ade9cb, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:11:48,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure e4b53b8853a8aaefd33dabaffd220d01, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:11:48,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:48,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4b53b8853a8aaefd33dabaffd220d01, NAME => 'testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. service=AccessControlService 2023-07-15 22:11:48,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cad4b4a89d4e49b870f807f86ade9cb, NAME => 'testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. service=AccessControlService 2023-07-15 22:11:48,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,488 INFO [StoreOpener-e4b53b8853a8aaefd33dabaffd220d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,489 INFO [StoreOpener-5cad4b4a89d4e49b870f807f86ade9cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,489 DEBUG [StoreOpener-e4b53b8853a8aaefd33dabaffd220d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf 2023-07-15 22:11:48,489 DEBUG [StoreOpener-e4b53b8853a8aaefd33dabaffd220d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf 2023-07-15 22:11:48,490 INFO [StoreOpener-e4b53b8853a8aaefd33dabaffd220d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4b53b8853a8aaefd33dabaffd220d01 columnFamilyName cf 2023-07-15 22:11:48,490 DEBUG [StoreOpener-5cad4b4a89d4e49b870f807f86ade9cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf 2023-07-15 22:11:48,490 DEBUG [StoreOpener-5cad4b4a89d4e49b870f807f86ade9cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf 2023-07-15 22:11:48,491 INFO [StoreOpener-5cad4b4a89d4e49b870f807f86ade9cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cad4b4a89d4e49b870f807f86ade9cb columnFamilyName cf 2023-07-15 22:11:48,491 INFO [StoreOpener-e4b53b8853a8aaefd33dabaffd220d01-1] regionserver.HStore(310): Store=e4b53b8853a8aaefd33dabaffd220d01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:48,492 INFO [StoreOpener-5cad4b4a89d4e49b870f807f86ade9cb-1] regionserver.HStore(310): Store=5cad4b4a89d4e49b870f807f86ade9cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:11:48,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:11:48,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:48,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:48,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4b53b8853a8aaefd33dabaffd220d01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68086442, jitterRate=0.014567047357559204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:48,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cad4b4a89d4e49b870f807f86ade9cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60401209, jitterRate=-0.0999518483877182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:48,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4b53b8853a8aaefd33dabaffd220d01: 2023-07-15 22:11:48,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cad4b4a89d4e49b870f807f86ade9cb: 2023-07-15 22:11:48,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01., pid=46, masterSystemTime=1689459108480 2023-07-15 22:11:48,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb., pid=45, masterSystemTime=1689459108479 2023-07-15 22:11:48,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,501 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e4b53b8853a8aaefd33dabaffd220d01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108501"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459108501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459108501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459108501"}]},"ts":"1689459108501"} 2023-07-15 22:11:48,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5cad4b4a89d4e49b870f807f86ade9cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459108502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459108502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459108502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459108502"}]},"ts":"1689459108502"} 2023-07-15 22:11:48,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-15 22:11:48,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure e4b53b8853a8aaefd33dabaffd220d01, server=jenkins-hbase4.apache.org,33297,1689459063148 in 177 msec 2023-07-15 22:11:48,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-15 22:11:48,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 5cad4b4a89d4e49b870f807f86ade9cb, server=jenkins-hbase4.apache.org,45695,1689459063074 in 178 msec 2023-07-15 22:11:48,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, ASSIGN in 338 msec 2023-07-15 22:11:48,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-15 22:11:48,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, ASSIGN in 339 msec 2023-07-15 22:11:48,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:48,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459108511"}]},"ts":"1689459108511"} 2023-07-15 22:11:48,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 22:11:48,514 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:48,514 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 22:11:48,516 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:48,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:48,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:48,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:48,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:48,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:48,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:48,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:48,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:48,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 419 msec 2023-07-15 22:11:48,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:48,716 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 22:11:48,718 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 22:11:48,718 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,720 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:48,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459108733 (current time:1689459108733). 2023-07-15 22:11:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x552555cb to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:48,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d77d4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:48,742 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x552555cb to 127.0.0.1:53851 2023-07-15 22:11:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:48,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x7184921c to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:48,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e700aea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:48,751 DEBUG [hconnection-0x72b1337c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:48,755 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:48,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:48,761 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:48,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7184921c to 127.0.0.1:53851 2023-07-15 22:11:48,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:48,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:48,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:48,767 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:48,768 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689459708768 2023-07-15 22:11:48,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 22:11:48,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:48,770 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:48,770 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:48,771 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:48,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:48,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-15 22:11:48,773 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:48,774 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689459708774 2023-07-15 22:11:48,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,786 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 22:11:48,786 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:48,787 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 22:11:48,787 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 22:11:48,788 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,788 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,791 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,791 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,791 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,792 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:48,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:48,801 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:48,801 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:48,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:48,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:48,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:48,806 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 22:11:48,806 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:48,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,808 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:48,809 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:48,809 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. started... 2023-07-15 22:11:48,809 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:48,809 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,809 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:48,809 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,809 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4b53b8853a8aaefd33dabaffd220d01: 2023-07-15 22:11:48,809 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. started... 2023-07-15 22:11:48,810 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,810 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cad4b4a89d4e49b870f807f86ade9cb: 2023-07-15 22:11:48,810 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:48,811 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:48,811 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,812 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:48,812 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:48,824 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:48,824 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:48,824 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:48,838 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. completed. 2023-07-15 22:11:48,838 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:48,838 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:48,838 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:48,838 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,838 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:48,839 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:48,840 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. completed. 2023-07-15 22:11:48,840 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:48,840 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:48,841 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:48,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:48,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:48,841 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:48,842 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:48,843 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:48,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:48,843 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:48,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:48,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:48,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:48,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:48,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:11:48,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 22:11:48,852 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 22:11:48,852 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:48,852 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:48,852 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,852 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,854 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,855 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:48,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,856 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:48,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,856 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:48,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,858 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:48,859 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,859 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:48,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:48,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 22:11:48,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,862 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:48,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:48,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,864 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:11:48,870 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:48,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:48,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:48,871 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:48,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 22:11:48,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,912 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:48,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689459108768Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689459108873 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689459108873Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689459108873Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689459108876 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689459108885 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689459108912 (+27 ms) 2023-07-15 22:11:48,915 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:48,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 146 msec 2023-07-15 22:11:49,072 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:49,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:49,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:49,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:49,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45695] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:49,080 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 22:11:49,080 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:49,080 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:49,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:49,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459109092 (current time:1689459109092). 2023-07-15 22:11:49,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:49,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x32a35710 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:49,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cc58698, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:49,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:49,109 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:49,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32a35710 to 127.0.0.1:53851 2023-07-15 22:11:49,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:49,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x58a4f01e to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:49,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@709737cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:49,118 DEBUG [hconnection-0x70668e01-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:49,121 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:49,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:49,126 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:49,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a4f01e to 127.0.0.1:53851 2023-07-15 22:11:49,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:49,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:49,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:49,131 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:49,132 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689459709132 2023-07-15 22:11:49,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 22:11:49,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:49,134 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:49,134 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:49,137 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:49,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:49,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 22:11:49,139 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:49,140 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689459709140 2023-07-15 22:11:49,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 22:11:49,151 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 22:11:49,151 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:49,152 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 22:11:49,152 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 22:11:49,153 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,153 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,155 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,155 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,155 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,155 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,156 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,156 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,156 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,156 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:49,157 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:49,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:49,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:49,159 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:49,159 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:49,159 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:49,160 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:49,159 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:49,162 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:49,162 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:49,163 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,164 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:49,164 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,165 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:49,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:49,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:49,170 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 22:11:49,170 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:49,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,172 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:49,172 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,172 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:49,172 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:49,172 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:49,172 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:49,172 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. started... 2023-07-15 22:11:49,173 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. started... 2023-07-15 22:11:49,173 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4b53b8853a8aaefd33dabaffd220d01 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 22:11:49,173 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5cad4b4a89d4e49b870f807f86ade9cb 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 22:11:49,175 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:49,175 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:49,175 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:49,197 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7 2023-07-15 22:11:49,199 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad 2023-07-15 22:11:49,209 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/.tmp/cf/705aef7d36854e3cba9f91e2e52e7122 2023-07-15 22:11:49,210 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/.tmp/cf/d2b7e2420b4d453d8f136b6ad6f82746 2023-07-15 22:11:49,217 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/.tmp/cf/705aef7d36854e3cba9f91e2e52e7122 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122 2023-07-15 22:11:49,219 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/.tmp/cf/d2b7e2420b4d453d8f136b6ad6f82746 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746 2023-07-15 22:11:49,223 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122, entries=44, sequenceid=6, filesize=12.2 K 2023-07-15 22:11:49,224 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5cad4b4a89d4e49b870f807f86ade9cb in 51ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:49,224 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 22:11:49,224 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746, entries=6, sequenceid=6, filesize=5.9 K 2023-07-15 22:11:49,224 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cad4b4a89d4e49b870f807f86ade9cb: 2023-07-15 22:11:49,224 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:49,225 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:49,225 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122] hfiles 2023-07-15 22:11:49,225 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:49,225 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e4b53b8853a8aaefd33dabaffd220d01 in 52ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:49,226 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4b53b8853a8aaefd33dabaffd220d01: 2023-07-15 22:11:49,227 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:49,227 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:49,227 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746] hfiles 2023-07-15 22:11:49,227 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:49,234 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. completed. 2023-07-15 22:11:49,234 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:11:49,234 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. completed. 2023-07-15 22:11:49,234 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:49,234 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:11:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:49,235 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:49,235 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,235 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:49,235 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:11:49,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:49,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:49,236 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:49,236 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:49,236 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,236 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:49,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:49,236 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:49,237 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:11:49,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 22:11:49,245 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 22:11:49,245 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:49,245 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:49,245 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 22:11:49,245 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,246 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,247 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,248 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:49,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:49,249 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:49,250 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,250 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:49,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 22:11:49,261 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,261 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:49,263 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:49,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:49,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:11:49,263 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,263 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,263 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,263 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:11:49,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:49,264 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:11:49,264 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,264 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad] mob files 2023-07-15 22:11:49,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7 2023-07-15 22:11:49,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad 2023-07-15 22:11:49,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 22:11:49,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 22:11:49,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,317 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689459109133Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689459109272 (+139 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689459109272Loading Region manifests for snaptb0-testConsecutiveExports at 1689459109272Writing data manifest for snaptb0-testConsecutiveExports at 1689459109276 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689459109291 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689459109317 (+26 ms) 2023-07-15 22:11:49,320 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:49,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 187 msec 2023-07-15 22:11:49,436 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:49,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:49,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:49,437 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437 2023-07-15 22:11:49,437 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:11:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@25635144, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,460 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 22:11:49,469 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:49,482 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,482 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,483 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,483 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,483 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,483 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,484 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,557 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-7856011289924090467.jar 2023-07-15 22:11:49,558 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,558 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,558 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,559 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,559 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,559 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:49,560 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:49,560 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:49,560 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:49,561 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:49,561 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:49,562 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:49,562 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:49,562 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:49,563 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:49,563 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:49,563 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:49,564 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:49,564 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:49,564 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:49,984 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:49,987 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 22:11:49,989 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 22:11:52,731 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:52,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:52,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:53,261 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0003_000001 (auth:SIMPLE) 2023-07-15 22:11:53,400 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:57,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0003_000001 (auth:SIMPLE) 2023-07-15 22:11:59,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0003_000001 (auth:SIMPLE) 2023-07-15 22:12:02,838 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0003_000001 (auth:SIMPLE) 2023-07-15 22:12:04,186 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:04,187 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:04,191 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 22:12:04,191 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:04,191 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:04,192 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:04,194 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:04,194 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:04,194 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7ff6be7f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:04,194 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:04,194 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:04,195 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:04,216 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:04,217 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1280c5f8, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:12:04,217 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 22:12:04,228 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:12:04,241 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,241 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,242 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,243 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,243 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,311 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-1704291875447718680.jar 2023-07-15 22:12:04,312 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,312 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,313 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,313 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,313 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,313 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:04,314 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:04,314 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:04,317 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:04,317 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:04,318 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:04,318 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:04,318 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:04,319 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:04,319 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:04,319 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:04,319 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:04,689 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:04,692 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 22:12:04,694 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 22:12:09,011 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:09,012 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:09,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0003_000001 (auth:SIMPLE) 2023-07-15 22:12:09,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:14,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:16,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:19,549 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:20,885 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:20,885 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:20,891 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 22:12:20,891 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:20,891 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:20,891 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:20,902 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:20,902 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:20,903 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7ff6be7f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:20,903 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:20,903 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/local-export-1689459109437/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:20,917 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 22:12:20,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 22:12:20,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:20,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:20,925 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459140925"}]},"ts":"1689459140925"} 2023-07-15 22:12:20,927 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 22:12:20,929 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 22:12:20,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, UNASSIGN}] 2023-07-15 22:12:20,932 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, UNASSIGN 2023-07-15 22:12:20,933 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, UNASSIGN 2023-07-15 22:12:20,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e4b53b8853a8aaefd33dabaffd220d01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:20,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459140934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459140934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459140934"}]},"ts":"1689459140934"} 2023-07-15 22:12:20,935 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5cad4b4a89d4e49b870f807f86ade9cb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:20,935 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459140935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459140935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459140935"}]},"ts":"1689459140935"} 2023-07-15 22:12:20,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure e4b53b8853a8aaefd33dabaffd220d01, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:12:20,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 5cad4b4a89d4e49b870f807f86ade9cb, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:21,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:21,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:12:21,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4b53b8853a8aaefd33dabaffd220d01, disabling compactions & flushes 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cad4b4a89d4e49b870f807f86ade9cb, disabling compactions & flushes 2023-07-15 22:12:21,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:12:21,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. after waiting 0 ms 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. after waiting 0 ms 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:12:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:12:21,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:21,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:21,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb. 2023-07-15 22:12:21,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cad4b4a89d4e49b870f807f86ade9cb: 2023-07-15 22:12:21,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:12:21,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5cad4b4a89d4e49b870f807f86ade9cb, regionState=CLOSED 2023-07-15 22:12:21,120 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459141119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459141119"}]},"ts":"1689459141119"} 2023-07-15 22:12:21,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:21,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:21,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01. 2023-07-15 22:12:21,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4b53b8853a8aaefd33dabaffd220d01: 2023-07-15 22:12:21,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:12:21,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e4b53b8853a8aaefd33dabaffd220d01, regionState=CLOSED 2023-07-15 22:12:21,134 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459141133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459141133"}]},"ts":"1689459141133"} 2023-07-15 22:12:21,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 22:12:21,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 5cad4b4a89d4e49b870f807f86ade9cb, server=jenkins-hbase4.apache.org,45695,1689459063074 in 184 msec 2023-07-15 22:12:21,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5cad4b4a89d4e49b870f807f86ade9cb, UNASSIGN in 204 msec 2023-07-15 22:12:21,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 22:12:21,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure e4b53b8853a8aaefd33dabaffd220d01, server=jenkins-hbase4.apache.org,33297,1689459063148 in 200 msec 2023-07-15 22:12:21,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 22:12:21,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e4b53b8853a8aaefd33dabaffd220d01, UNASSIGN in 210 msec 2023-07-15 22:12:21,145 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459141145"}]},"ts":"1689459141145"} 2023-07-15 22:12:21,148 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 22:12:21,150 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 22:12:21,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 235 msec 2023-07-15 22:12:21,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:21,226 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 22:12:21,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 22:12:21,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,231 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 22:12:21,235 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,236 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 22:12:21,240 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,243 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,243 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,244 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:21,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:21,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:21,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:21,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:21,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:21,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:21,250 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:21,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:21,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 22:12:21,261 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:12:21,262 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:12:21,265 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/recovered.edits] 2023-07-15 22:12:21,266 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/recovered.edits] 2023-07-15 22:12:21,273 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/cf/d2b7e2420b4d453d8f136b6ad6f82746 2023-07-15 22:12:21,277 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/cf/705aef7d36854e3cba9f91e2e52e7122 2023-07-15 22:12:21,281 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01/recovered.edits/9.seqid 2023-07-15 22:12:21,282 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/e4b53b8853a8aaefd33dabaffd220d01 2023-07-15 22:12:21,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb/recovered.edits/9.seqid 2023-07-15 22:12:21,284 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testConsecutiveExports/5cad4b4a89d4e49b870f807f86ade9cb 2023-07-15 22:12:21,284 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 22:12:21,285 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 22:12:21,286 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-15 22:12:21,295 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071565710bde6e944edfb117bcf27143a6d7 2023-07-15 22:12:21,299 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155e760787a4604f7fa2687550e4cc81ad 2023-07-15 22:12:21,300 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 22:12:21,304 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,324 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 22:12:21,339 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 22:12:21,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 22:12:21,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459141341"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:21,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459141341"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:21,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 22:12:21,358 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:21,358 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4b53b8853a8aaefd33dabaffd220d01, NAME => 'testtb-testConsecutiveExports,,1689459108105.e4b53b8853a8aaefd33dabaffd220d01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5cad4b4a89d4e49b870f807f86ade9cb, NAME => 'testtb-testConsecutiveExports,1,1689459108105.5cad4b4a89d4e49b870f807f86ade9cb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:21,358 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 22:12:21,358 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459141358"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:21,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 22:12:21,371 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:21,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 144 msec 2023-07-15 22:12:21,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 22:12:21,556 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 22:12:21,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 22:12:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 22:12:21,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 22:12:21,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 22:12:21,624 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 767), OpenFileDescriptor=908 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=387 (was 347) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 180), AvailableMemoryMB=3469 (was 2836) - AvailableMemoryMB LEAK? - 2023-07-15 22:12:21,624 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-15 22:12:21,651 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=387, ProcessCount=179, AvailableMemoryMB=3461 2023-07-15 22:12:21,652 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-15 22:12:21,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:12:21,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:21,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:21,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 22:12:21,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:21,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:21,672 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:21,673 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c empty. 2023-07-15 22:12:21,673 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:21,674 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:21,674 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd empty. 2023-07-15 22:12:21,675 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:21,675 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 22:12:21,733 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:21,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f5d4ed5b128b87fee6c70ca603aafc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:21,738 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 687ade639d63b1796aafdbd0c79d9bfd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:21,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:21,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:21,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f5d4ed5b128b87fee6c70ca603aafc9c, disabling compactions & flushes 2023-07-15 22:12:21,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:21,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:21,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. after waiting 0 ms 2023-07-15 22:12:21,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:21,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:21,801 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f5d4ed5b128b87fee6c70ca603aafc9c: 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 687ade639d63b1796aafdbd0c79d9bfd, disabling compactions & flushes 2023-07-15 22:12:21,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. after waiting 0 ms 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:21,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:21,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 687ade639d63b1796aafdbd0c79d9bfd: 2023-07-15 22:12:21,808 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:21,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459141809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459141809"}]},"ts":"1689459141809"} 2023-07-15 22:12:21,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459141809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459141809"}]},"ts":"1689459141809"} 2023-07-15 22:12:21,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:21,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:21,851 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459141851"}]},"ts":"1689459141851"} 2023-07-15 22:12:21,853 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 22:12:21,858 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:21,859 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:21,860 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:21,860 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:21,860 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:21,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, ASSIGN}] 2023-07-15 22:12:21,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, ASSIGN 2023-07-15 22:12:21,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, ASSIGN 2023-07-15 22:12:21,865 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:12:21,865 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689459063148; forceNewPlan=false, retain=false 2023-07-15 22:12:21,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:22,015 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:22,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=687ade639d63b1796aafdbd0c79d9bfd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459142019"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459142019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459142019"}]},"ts":"1689459142019"} 2023-07-15 22:12:22,019 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f5d4ed5b128b87fee6c70ca603aafc9c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459142019"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459142019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459142019"}]},"ts":"1689459142019"} 2023-07-15 22:12:22,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 687ade639d63b1796aafdbd0c79d9bfd, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:22,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f5d4ed5b128b87fee6c70ca603aafc9c, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:12:22,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:22,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5d4ed5b128b87fee6c70ca603aafc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:12:22,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. service=AccessControlService 2023-07-15 22:12:22,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:22,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:22,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:22,188 INFO [StoreOpener-f5d4ed5b128b87fee6c70ca603aafc9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 687ade639d63b1796aafdbd0c79d9bfd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. service=AccessControlService 2023-07-15 22:12:22,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,191 DEBUG [StoreOpener-f5d4ed5b128b87fee6c70ca603aafc9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf 2023-07-15 22:12:22,191 DEBUG [StoreOpener-f5d4ed5b128b87fee6c70ca603aafc9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf 2023-07-15 22:12:22,193 INFO [StoreOpener-f5d4ed5b128b87fee6c70ca603aafc9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5d4ed5b128b87fee6c70ca603aafc9c columnFamilyName cf 2023-07-15 22:12:22,196 INFO [StoreOpener-687ade639d63b1796aafdbd0c79d9bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,207 DEBUG [StoreOpener-687ade639d63b1796aafdbd0c79d9bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf 2023-07-15 22:12:22,207 DEBUG [StoreOpener-687ade639d63b1796aafdbd0c79d9bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf 2023-07-15 22:12:22,208 INFO [StoreOpener-687ade639d63b1796aafdbd0c79d9bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 687ade639d63b1796aafdbd0c79d9bfd columnFamilyName cf 2023-07-15 22:12:22,213 INFO [StoreOpener-687ade639d63b1796aafdbd0c79d9bfd-1] regionserver.HStore(310): Store=687ade639d63b1796aafdbd0c79d9bfd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:22,213 INFO [StoreOpener-f5d4ed5b128b87fee6c70ca603aafc9c-1] regionserver.HStore(310): Store=f5d4ed5b128b87fee6c70ca603aafc9c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:22,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:22,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:22,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:22,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:22,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f5d4ed5b128b87fee6c70ca603aafc9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68830737, jitterRate=0.025657907128334045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:22,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f5d4ed5b128b87fee6c70ca603aafc9c: 2023-07-15 22:12:22,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c., pid=61, masterSystemTime=1689459142175 2023-07-15 22:12:22,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 687ade639d63b1796aafdbd0c79d9bfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60557304, jitterRate=-0.09762585163116455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:22,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 687ade639d63b1796aafdbd0c79d9bfd: 2023-07-15 22:12:22,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:22,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:22,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd., pid=60, masterSystemTime=1689459142175 2023-07-15 22:12:22,243 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f5d4ed5b128b87fee6c70ca603aafc9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459142243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459142243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459142243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459142243"}]},"ts":"1689459142243"} 2023-07-15 22:12:22,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:22,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:22,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=687ade639d63b1796aafdbd0c79d9bfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459142256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459142256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459142256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459142256"}]},"ts":"1689459142256"} 2023-07-15 22:12:22,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 22:12:22,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f5d4ed5b128b87fee6c70ca603aafc9c, server=jenkins-hbase4.apache.org,33297,1689459063148 in 228 msec 2023-07-15 22:12:22,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, ASSIGN in 397 msec 2023-07-15 22:12:22,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 22:12:22,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 687ade639d63b1796aafdbd0c79d9bfd, server=jenkins-hbase4.apache.org,45299,1689459063195 in 236 msec 2023-07-15 22:12:22,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-15 22:12:22,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, ASSIGN in 400 msec 2023-07-15 22:12:22,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:22,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459142265"}]},"ts":"1689459142265"} 2023-07-15 22:12:22,268 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 22:12:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:22,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:22,271 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 22:12:22,273 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:22,274 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:22,274 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:22,274 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:22,274 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:22,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:22,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:22,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:22,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:22,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 626 msec 2023-07-15 22:12:22,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:22,770 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 22:12:22,777 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,777 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:22,779 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:22,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:22,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459142811 (current time:1689459142811). 2023-07-15 22:12:22,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:22,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x581339ca to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74318233, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:22,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:22,829 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:22,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x581339ca to 127.0.0.1:53851 2023-07-15 22:12:22,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:22,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x428feece to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:22,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@393523c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:22,859 DEBUG [hconnection-0x7b4b7867-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:22,860 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:22,877 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:22,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x428feece to 127.0.0.1:53851 2023-07-15 22:12:22,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:22,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:22,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:22,884 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:22,887 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689459742887 2023-07-15 22:12:22,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:22,887 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,889 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:22,889 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:22,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:22,890 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:22,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-15 22:12:22,893 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:22,896 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689459742896 2023-07-15 22:12:22,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,947 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:22,947 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:22,952 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 22:12:22,952 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 22:12:22,953 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,953 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,955 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:22,955 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:22,955 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,955 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,959 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,959 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,960 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:22,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,961 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:22,961 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:22,962 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,962 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:22,963 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:22,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:22,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,963 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:22,963 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:22,964 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:22,964 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:22,964 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:22,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:22,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:22,969 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,969 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:22,976 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:22,976 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,976 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:22,976 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,976 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,976 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:22,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:22,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:22,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:22,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:22,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:22,981 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 22:12:22,981 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:22,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:22,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,983 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:22,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,983 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:12:22,983 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. started... 2023-07-15 22:12:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:22,983 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:22,984 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:22,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5d4ed5b128b87fee6c70ca603aafc9c: 2023-07-15 22:12:22,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:22,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:22,984 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:22,984 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:22,985 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:22,985 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. started... 2023-07-15 22:12:22,994 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:22,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:22,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:22,996 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:22,997 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 687ade639d63b1796aafdbd0c79d9bfd: 2023-07-15 22:12:22,998 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:22,998 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:22,998 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,003 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,063 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. completed. 2023-07-15 22:12:23,063 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:23,064 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:12:23,066 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,066 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,066 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,066 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,073 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. completed. 2023-07-15 22:12:23,073 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 22:12:23,075 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:12:23,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 22:12:23,079 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 22:12:23,079 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:23,079 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:23,079 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,079 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:23,081 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,081 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,082 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,083 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,084 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,087 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,088 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,089 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,089 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,089 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,089 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,093 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,093 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,094 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,099 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:12:23,099 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,101 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,101 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,101 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,102 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,102 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,102 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,102 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:12:23,102 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,196 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:23,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:23,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:23,197 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:23,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 22:12:23,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,230 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689459142888Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689459143123 (+235 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459143123Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459143123Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459143134 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459143156 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689459143229 (+73 ms) 2023-07-15 22:12:23,234 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:23,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 345 msec 2023-07-15 22:12:23,498 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:23,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:23,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:23,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:23,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45299] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:23,513 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,514 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:23,514 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:23,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:23,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459143528 (current time:1689459143528). 2023-07-15 22:12:23,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:23,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x748b6326 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:23,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@676b773d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:23,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:23,547 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:23,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748b6326 to 127.0.0.1:53851 2023-07-15 22:12:23,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:23,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x30aecc6b to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:23,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5707fb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:23,562 DEBUG [hconnection-0x4cee354c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:23,566 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:23,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:23,574 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:23,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30aecc6b to 127.0.0.1:53851 2023-07-15 22:12:23,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:23,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:23,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:23,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:23,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:23,588 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:23,589 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689459743589 2023-07-15 22:12:23,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:23,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,590 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:23,592 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:23,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:23,594 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:23,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-15 22:12:23,600 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:23,600 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689459743600 2023-07-15 22:12:23,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,623 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:23,623 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:23,625 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 22:12:23,625 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 22:12:23,681 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,681 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,684 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,684 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,684 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,684 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,685 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,685 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,690 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,690 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:23,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,691 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:23,691 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:23,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:23,693 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:23,695 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:23,695 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:23,696 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:23,696 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:23,696 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:23,696 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:23,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:23,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:23,697 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:23,697 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,698 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@378c5131[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:23,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@378c5131[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:23,706 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 22:12:23,706 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,708 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,708 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,709 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,709 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:23,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:23,711 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:23,711 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. started... 2023-07-15 22:12:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,711 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:12:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:23,712 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 687ade639d63b1796aafdbd0c79d9bfd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 22:12:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:23,712 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:23,712 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. started... 2023-07-15 22:12:23,712 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f5d4ed5b128b87fee6c70ca603aafc9c 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 22:12:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,732 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:23,766 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d 2023-07-15 22:12:23,771 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df 2023-07-15 22:12:23,784 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/.tmp/cf/d814dd1d18744d898608c722d5334322 2023-07-15 22:12:23,791 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/.tmp/cf/d814dd1d18744d898608c722d5334322 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322 2023-07-15 22:12:23,793 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/.tmp/cf/9ada190a68a14640a0a6c14bd5b73453 2023-07-15 22:12:23,799 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/.tmp/cf/9ada190a68a14640a0a6c14bd5b73453 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453 2023-07-15 22:12:23,800 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 22:12:23,801 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for f5d4ed5b128b87fee6c70ca603aafc9c in 89ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:23,803 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5d4ed5b128b87fee6c70ca603aafc9c: 2023-07-15 22:12:23,803 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,803 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:23,803 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322] hfiles 2023-07-15 22:12:23,803 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,810 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453, entries=46, sequenceid=6, filesize=13.3 K 2023-07-15 22:12:23,811 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 687ade639d63b1796aafdbd0c79d9bfd in 99ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:23,812 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 687ade639d63b1796aafdbd0c79d9bfd: 2023-07-15 22:12:23,812 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,812 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:23,812 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453] hfiles 2023-07-15 22:12:23,812 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,817 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. completed. 2023-07-15 22:12:23,817 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,819 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:12:23,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 22:12:23,841 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. completed. 2023-07-15 22:12:23,841 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:12:23,843 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,843 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,843 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,843 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 22:12:23,850 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 22:12:23,850 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:23,850 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:23,850 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,850 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:23,861 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,861 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:23,861 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,861 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:23,861 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,863 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,863 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:23,865 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,865 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,866 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,869 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:23,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:23,871 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,869 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:23,871 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,871 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:23,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,871 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,872 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:23,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:23,872 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:23,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,872 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:12:23,872 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d] mob files 2023-07-15 22:12:23,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df 2023-07-15 22:12:23,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d 2023-07-15 22:12:23,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,897 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:23,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:23,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:23,899 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:23,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 22:12:23,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,955 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:23,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689459143589Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689459143884 (+295 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689459143884Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689459143884Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689459143888 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689459143915 (+27 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689459143954 (+39 ms) 2023-07-15 22:12:23,958 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:23,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 367 msec 2023-07-15 22:12:24,199 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:24,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:24,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:24,229 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:24,233 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:24,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:24,235 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:24,240 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:24,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45299] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:24,241 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:24,246 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:24,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45695] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:24,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:12:24,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:24,251 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:24,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 22:12:24,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:24,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:24,256 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,256 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,256 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d empty. 2023-07-15 22:12:24,256 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 empty. 2023-07-15 22:12:24,257 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,257 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 22:12:24,267 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:24,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1b3db535b72d3ab655a6f6f739d422b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:24,269 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9aee53d335acbcfa8f9a8f2924eec8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d9aee53d335acbcfa8f9a8f2924eec8d, disabling compactions & flushes 2023-07-15 22:12:24,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. after waiting 0 ms 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d9aee53d335acbcfa8f9a8f2924eec8d: 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 1b3db535b72d3ab655a6f6f739d422b0, disabling compactions & flushes 2023-07-15 22:12:24,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. after waiting 0 ms 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 1b3db535b72d3ab655a6f6f739d422b0: 2023-07-15 22:12:24,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:24,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459144296"}]},"ts":"1689459144296"} 2023-07-15 22:12:24,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459144296"}]},"ts":"1689459144296"} 2023-07-15 22:12:24,299 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:24,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:24,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459144301"}]},"ts":"1689459144301"} 2023-07-15 22:12:24,302 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 22:12:24,306 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:24,310 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:24,310 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:24,310 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:24,310 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:24,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, ASSIGN}] 2023-07-15 22:12:24,314 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, ASSIGN 2023-07-15 22:12:24,314 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, ASSIGN 2023-07-15 22:12:24,317 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:12:24,317 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:12:24,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:24,468 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:24,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b3db535b72d3ab655a6f6f739d422b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:24,471 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d9aee53d335acbcfa8f9a8f2924eec8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:24,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459144470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459144470"}]},"ts":"1689459144470"} 2023-07-15 22:12:24,471 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459144470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459144470"}]},"ts":"1689459144470"} 2023-07-15 22:12:24,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 1b3db535b72d3ab655a6f6f739d422b0, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:24,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d9aee53d335acbcfa8f9a8f2924eec8d, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:24,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:24,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b3db535b72d3ab655a6f6f739d422b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 22:12:24,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9aee53d335acbcfa8f9a8f2924eec8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 22:12:24,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. service=AccessControlService 2023-07-15 22:12:24,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. service=AccessControlService 2023-07-15 22:12:24,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:24,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:24,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,633 INFO [StoreOpener-d9aee53d335acbcfa8f9a8f2924eec8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,633 INFO [StoreOpener-1b3db535b72d3ab655a6f6f739d422b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,635 DEBUG [StoreOpener-1b3db535b72d3ab655a6f6f739d422b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf 2023-07-15 22:12:24,635 DEBUG [StoreOpener-1b3db535b72d3ab655a6f6f739d422b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf 2023-07-15 22:12:24,635 DEBUG [StoreOpener-d9aee53d335acbcfa8f9a8f2924eec8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf 2023-07-15 22:12:24,635 DEBUG [StoreOpener-d9aee53d335acbcfa8f9a8f2924eec8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf 2023-07-15 22:12:24,635 INFO [StoreOpener-1b3db535b72d3ab655a6f6f739d422b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b3db535b72d3ab655a6f6f739d422b0 columnFamilyName cf 2023-07-15 22:12:24,636 INFO [StoreOpener-1b3db535b72d3ab655a6f6f739d422b0-1] regionserver.HStore(310): Store=1b3db535b72d3ab655a6f6f739d422b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:24,636 INFO [StoreOpener-d9aee53d335acbcfa8f9a8f2924eec8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9aee53d335acbcfa8f9a8f2924eec8d columnFamilyName cf 2023-07-15 22:12:24,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,637 INFO [StoreOpener-d9aee53d335acbcfa8f9a8f2924eec8d-1] regionserver.HStore(310): Store=d9aee53d335acbcfa8f9a8f2924eec8d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:24,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:24,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:24,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:24,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b3db535b72d3ab655a6f6f739d422b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64889135, jitterRate=-0.033076539635658264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:24,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b3db535b72d3ab655a6f6f739d422b0: 2023-07-15 22:12:24,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9aee53d335acbcfa8f9a8f2924eec8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62387428, jitterRate=-0.0703548789024353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:24,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9aee53d335acbcfa8f9a8f2924eec8d: 2023-07-15 22:12:24,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0., pid=69, masterSystemTime=1689459144626 2023-07-15 22:12:24,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d., pid=70, masterSystemTime=1689459144628 2023-07-15 22:12:24,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:24,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b3db535b72d3ab655a6f6f739d422b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:24,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459144651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459144651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459144651"}]},"ts":"1689459144651"} 2023-07-15 22:12:24,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:24,652 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d9aee53d335acbcfa8f9a8f2924eec8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:24,652 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144652"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459144652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459144652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459144652"}]},"ts":"1689459144652"} 2023-07-15 22:12:24,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-15 22:12:24,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 1b3db535b72d3ab655a6f6f739d422b0, server=jenkins-hbase4.apache.org,45695,1689459063074 in 180 msec 2023-07-15 22:12:24,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-15 22:12:24,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d9aee53d335acbcfa8f9a8f2924eec8d, server=jenkins-hbase4.apache.org,45299,1689459063195 in 178 msec 2023-07-15 22:12:24,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, ASSIGN in 345 msec 2023-07-15 22:12:24,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 22:12:24,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, ASSIGN in 346 msec 2023-07-15 22:12:24,659 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:24,659 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459144659"}]},"ts":"1689459144659"} 2023-07-15 22:12:24,660 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 22:12:24,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:24,664 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 22:12:24,666 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 22:12:24,667 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:24,667 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:24,667 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:24,667 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:24,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 420 msec 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:24,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:24,858 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 22:12:24,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:24,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0], force=true 2023-07-15 22:12:24,908 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0], force=true 2023-07-15 22:12:24,908 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0], force=true 2023-07-15 22:12:24,909 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0], force=true 2023-07-15 22:12:24,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:24,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, UNASSIGN}] 2023-07-15 22:12:24,956 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, UNASSIGN 2023-07-15 22:12:24,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d9aee53d335acbcfa8f9a8f2924eec8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:24,957 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459144957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459144957"}]},"ts":"1689459144957"} 2023-07-15 22:12:24,967 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, UNASSIGN 2023-07-15 22:12:24,969 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b3db535b72d3ab655a6f6f739d422b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:24,969 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459144969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459144969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459144969"}]},"ts":"1689459144969"} 2023-07-15 22:12:24,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d9aee53d335acbcfa8f9a8f2924eec8d, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:24,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 1b3db535b72d3ab655a6f6f739d422b0, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:25,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:25,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:25,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:25,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b3db535b72d3ab655a6f6f739d422b0, disabling compactions & flushes 2023-07-15 22:12:25,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9aee53d335acbcfa8f9a8f2924eec8d, disabling compactions & flushes 2023-07-15 22:12:25,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:25,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:25,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. after waiting 0 ms 2023-07-15 22:12:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. after waiting 0 ms 2023-07-15 22:12:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:25,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b3db535b72d3ab655a6f6f739d422b0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 22:12:25,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9aee53d335acbcfa8f9a8f2924eec8d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 22:12:25,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/.tmp/cf/d012d67331f44cfcabb9f2bb6083e211 2023-07-15 22:12:25,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/.tmp/cf/7dd4b1a26c41403b9985c90779c74525 2023-07-15 22:12:25,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/.tmp/cf/7dd4b1a26c41403b9985c90779c74525 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525 2023-07-15 22:12:25,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/.tmp/cf/d012d67331f44cfcabb9f2bb6083e211 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211 2023-07-15 22:12:25,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 22:12:25,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1b3db535b72d3ab655a6f6f739d422b0 in 54ms, sequenceid=5, compaction requested=false 2023-07-15 22:12:25,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 22:12:25,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 22:12:25,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d9aee53d335acbcfa8f9a8f2924eec8d in 63ms, sequenceid=5, compaction requested=false 2023-07-15 22:12:25,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 22:12:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 22:12:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:25,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0. 2023-07-15 22:12:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b3db535b72d3ab655a6f6f739d422b0: 2023-07-15 22:12:25,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:25,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d. 2023-07-15 22:12:25,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9aee53d335acbcfa8f9a8f2924eec8d: 2023-07-15 22:12:25,211 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b3db535b72d3ab655a6f6f739d422b0, regionState=CLOSED 2023-07-15 22:12:25,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:25,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459145211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459145211"}]},"ts":"1689459145211"} 2023-07-15 22:12:25,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:25,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d9aee53d335acbcfa8f9a8f2924eec8d, regionState=CLOSED 2023-07-15 22:12:25,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459145214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459145214"}]},"ts":"1689459145214"} 2023-07-15 22:12:25,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 22:12:25,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 1b3db535b72d3ab655a6f6f739d422b0, server=jenkins-hbase4.apache.org,45695,1689459063074 in 241 msec 2023-07-15 22:12:25,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:25,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 22:12:25,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d9aee53d335acbcfa8f9a8f2924eec8d, server=jenkins-hbase4.apache.org,45299,1689459063195 in 244 msec 2023-07-15 22:12:25,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b3db535b72d3ab655a6f6f739d422b0, UNASSIGN in 266 msec 2023-07-15 22:12:25,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-15 22:12:25,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9aee53d335acbcfa8f9a8f2924eec8d, UNASSIGN in 270 msec 2023-07-15 22:12:25,330 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 22:12:25,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144248.d9aee53d335acbcfa8f9a8f2924eec8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:25,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459144248.1b3db535b72d3ab655a6f6f739d422b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:25,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:25,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, ASSIGN}] 2023-07-15 22:12:25,404 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, ASSIGN 2023-07-15 22:12:25,405 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:12:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:25,556 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:12:25,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=70986e66ed958f5b94595207f164c98b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:25,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459145558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459145558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459145558"}]},"ts":"1689459145558"} 2023-07-15 22:12:25,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 70986e66ed958f5b94595207f164c98b, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:25,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:25,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70986e66ed958f5b94595207f164c98b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:12:25,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. service=AccessControlService 2023-07-15 22:12:25,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:25,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/.regioninfo 2023-07-15 22:12:25,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:26,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:26,159 INFO [StoreOpener-70986e66ed958f5b94595207f164c98b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:26,161 DEBUG [StoreOpener-70986e66ed958f5b94595207f164c98b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf 2023-07-15 22:12:26,161 DEBUG [StoreOpener-70986e66ed958f5b94595207f164c98b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf 2023-07-15 22:12:26,161 INFO [StoreOpener-70986e66ed958f5b94595207f164c98b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70986e66ed958f5b94595207f164c98b columnFamilyName cf 2023-07-15 22:12:26,229 DEBUG [StoreOpener-70986e66ed958f5b94595207f164c98b-1] regionserver.HStore(539): loaded hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/7dd4b1a26c41403b9985c90779c74525.1b3db535b72d3ab655a6f6f739d422b0->hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525-top 2023-07-15 22:12:26,263 DEBUG [StoreOpener-70986e66ed958f5b94595207f164c98b-1] regionserver.HStore(539): loaded hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/d012d67331f44cfcabb9f2bb6083e211.d9aee53d335acbcfa8f9a8f2924eec8d->hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211-top 2023-07-15 22:12:26,264 INFO [StoreOpener-70986e66ed958f5b94595207f164c98b-1] regionserver.HStore(310): Store=70986e66ed958f5b94595207f164c98b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:26,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:26,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:26,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:26,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 70986e66ed958f5b94595207f164c98b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68954440, jitterRate=0.027501225471496582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:26,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 70986e66ed958f5b94595207f164c98b: 2023-07-15 22:12:26,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b., pid=77, masterSystemTime=1689459145712 2023-07-15 22:12:26,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.,because compaction is disabled. 2023-07-15 22:12:26,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:26,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:26,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=70986e66ed958f5b94595207f164c98b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:26,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459146281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459146281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459146281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459146281"}]},"ts":"1689459146281"} 2023-07-15 22:12:26,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 22:12:26,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 70986e66ed958f5b94595207f164c98b, server=jenkins-hbase4.apache.org,45299,1689459063195 in 723 msec 2023-07-15 22:12:26,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 22:12:26,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, ASSIGN in 886 msec 2023-07-15 22:12:26,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d9aee53d335acbcfa8f9a8f2924eec8d, 1b3db535b72d3ab655a6f6f739d422b0], force=true in 1.3930 sec 2023-07-15 22:12:26,752 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:12:27,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:27,025 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 22:12:27,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459147026 (current time:1689459147026). 2023-07-15 22:12:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:27,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x41a7006b to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:27,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cc851d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:27,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:27,070 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:27,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41a7006b to 127.0.0.1:53851 2023-07-15 22:12:27,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:27,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x19d8a50c to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:27,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60854a04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:27,095 DEBUG [hconnection-0x1cf64-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:27,098 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:27,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:27,107 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:27,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19d8a50c to 127.0.0.1:53851 2023-07-15 22:12:27,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:27,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 22:12:27,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:27,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:27,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:27,122 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:27,122 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689459747122 2023-07-15 22:12:27,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:27,127 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:27,127 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:27,128 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:27,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:27,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-15 22:12:27,142 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:27,143 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689459747143 2023-07-15 22:12:27,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,213 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 22:12:27,216 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:27,217 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 22:12:27,217 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 22:12:27,219 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,219 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,220 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,220 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,220 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,221 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,221 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:27,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:27,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:27,227 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,227 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:27,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:27,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 22:12:27,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:27,229 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:27,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,235 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:27,235 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:27,240 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:27,243 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:27,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:27,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:27,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:27,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 22:12:27,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca4b5ed[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:27,246 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 22:12:27,246 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,247 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,247 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:27,248 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,248 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:27,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,250 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:27,250 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:27,253 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:27,254 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:27,253 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. started... 2023-07-15 22:12:27,254 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:27,254 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:27,255 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70986e66ed958f5b94595207f164c98b: 2023-07-15 22:12:27,256 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,256 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:27,256 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/7dd4b1a26c41403b9985c90779c74525.1b3db535b72d3ab655a6f6f739d422b0->hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525-top, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/d012d67331f44cfcabb9f2bb6083e211.d9aee53d335acbcfa8f9a8f2924eec8d->hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211-top] hfiles 2023-07-15 22:12:27,256 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/7dd4b1a26c41403b9985c90779c74525.1b3db535b72d3ab655a6f6f739d422b0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,257 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/d012d67331f44cfcabb9f2bb6083e211.d9aee53d335acbcfa8f9a8f2924eec8d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:12:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:27,260 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:27,285 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. completed. 2023-07-15 22:12:27,285 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:27,285 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:12:27,296 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,296 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:27,297 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:27,297 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:27,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:27,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:12:27,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 22:12:27,301 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 22:12:27,302 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:27,302 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:27,302 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,302 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:27,303 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,303 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,303 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,303 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,303 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,304 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,304 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,305 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,306 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,309 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:27,309 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,311 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,320 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,320 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,320 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,321 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:27,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:27,322 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:27,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:27,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,321 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,327 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:27,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:27,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,430 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:27,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 22:12:27,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:27,431 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:27,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 22:12:27,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,443 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689459147123Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459147321 (+198 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459147321Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459147353 (+32 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459147395 (+42 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689459147442 (+47 ms) 2023-07-15 22:12:27,446 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:27,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 319 msec 2023-07-15 22:12:27,731 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:27,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 22:12:27,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:27,733 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733 2023-07-15 22:12:27,733 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38251, tgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733, rawTgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:27,767 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:27,767 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_120177309_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,767 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 22:12:27,809 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:27,918 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,919 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,920 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,920 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,921 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,921 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:27,921 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,027 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-9048218491615545852.jar 2023-07-15 22:12:28,027 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,028 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,028 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,029 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,029 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,030 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:28,030 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:28,031 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:28,031 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:28,032 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:28,033 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:28,033 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:28,034 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:28,034 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:28,035 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:28,035 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:28,036 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:28,036 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:28,037 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:28,037 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:28,038 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:28,038 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:28,039 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:28,133 WARN [DataStreamer for file /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689459072256_0005/libjars/hadoop-9048218491615545852.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-15 22:12:28,907 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:28,909 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 22:12:28,911 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 22:12:28,997 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:28,997 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:29,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:35,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:37,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:44,157 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:44,160 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:44,178 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,179 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:44,179 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 22:12:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 22:12:44,180 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 22:12:44,181 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459147733/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 22:12:44,189 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:44,203 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459164202"}]},"ts":"1689459164202"} 2023-07-15 22:12:44,204 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 22:12:44,206 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 22:12:44,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, UNASSIGN}] 2023-07-15 22:12:44,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, UNASSIGN 2023-07-15 22:12:44,210 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=70986e66ed958f5b94595207f164c98b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:44,211 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459164210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459164210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459164210"}]},"ts":"1689459164210"} 2023-07-15 22:12:44,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 70986e66ed958f5b94595207f164c98b, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:44,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:44,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:44,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 70986e66ed958f5b94595207f164c98b, disabling compactions & flushes 2023-07-15 22:12:44,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:44,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:44,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. after waiting 0 ms 2023-07-15 22:12:44,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:44,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 22:12:44,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:44,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b. 2023-07-15 22:12:44,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 70986e66ed958f5b94595207f164c98b: 2023-07-15 22:12:44,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:44,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=70986e66ed958f5b94595207f164c98b, regionState=CLOSED 2023-07-15 22:12:44,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459164386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459164386"}]},"ts":"1689459164386"} 2023-07-15 22:12:44,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 22:12:44,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 70986e66ed958f5b94595207f164c98b, server=jenkins-hbase4.apache.org,45299,1689459063195 in 176 msec 2023-07-15 22:12:44,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 22:12:44,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=70986e66ed958f5b94595207f164c98b, UNASSIGN in 183 msec 2023-07-15 22:12:44,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459164392"}]},"ts":"1689459164392"} 2023-07-15 22:12:44,394 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 22:12:44,403 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 22:12:44,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 213 msec 2023-07-15 22:12:44,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:44,505 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 22:12:44,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,520 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,525 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:44,525 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:44,525 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:44,526 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,526 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,526 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,526 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:44,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:44,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:44,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:44,527 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/recovered.edits] 2023-07-15 22:12:44,528 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/recovered.edits] 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,528 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,529 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,529 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:44,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:44,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:44,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:44,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 22:12:44,531 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/recovered.edits] 2023-07-15 22:12:44,534 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/7dd4b1a26c41403b9985c90779c74525.1b3db535b72d3ab655a6f6f739d422b0 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/7dd4b1a26c41403b9985c90779c74525.1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:44,536 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/d012d67331f44cfcabb9f2bb6083e211.d9aee53d335acbcfa8f9a8f2924eec8d to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/cf/d012d67331f44cfcabb9f2bb6083e211.d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:44,540 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/recovered.edits/12.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b/recovered.edits/12.seqid 2023-07-15 22:12:44,541 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/70986e66ed958f5b94595207f164c98b 2023-07-15 22:12:44,544 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/cf/7dd4b1a26c41403b9985c90779c74525 2023-07-15 22:12:44,544 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/cf/d012d67331f44cfcabb9f2bb6083e211 2023-07-15 22:12:44,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/recovered.edits/8.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0/recovered.edits/8.seqid 2023-07-15 22:12:44,550 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b3db535b72d3ab655a6f6f739d422b0 2023-07-15 22:12:44,551 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/recovered.edits/8.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d/recovered.edits/8.seqid 2023-07-15 22:12:44,552 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9aee53d335acbcfa8f9a8f2924eec8d 2023-07-15 22:12:44,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 22:12:44,554 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,557 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 22:12:44,559 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 22:12:44,561 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,561 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 22:12:44,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459164561"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:44,563 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 22:12:44,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 70986e66ed958f5b94595207f164c98b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459144249.70986e66ed958f5b94595207f164c98b.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 22:12:44,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 22:12:44,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459164563"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:44,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 22:12:44,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:44,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 60 msec 2023-07-15 22:12:44,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 22:12:44,632 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 22:12:44,633 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:44,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459164642"}]},"ts":"1689459164642"} 2023-07-15 22:12:44,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 22:12:44,648 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 22:12:44,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, UNASSIGN}] 2023-07-15 22:12:44,651 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, UNASSIGN 2023-07-15 22:12:44,651 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, UNASSIGN 2023-07-15 22:12:44,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f5d4ed5b128b87fee6c70ca603aafc9c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:44,652 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=687ade639d63b1796aafdbd0c79d9bfd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:44,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459164652"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459164652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459164652"}]},"ts":"1689459164652"} 2023-07-15 22:12:44,652 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459164652"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459164652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459164652"}]},"ts":"1689459164652"} 2023-07-15 22:12:44,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f5d4ed5b128b87fee6c70ca603aafc9c, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:12:44,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 687ade639d63b1796aafdbd0c79d9bfd, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:44,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:44,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:44,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f5d4ed5b128b87fee6c70ca603aafc9c, disabling compactions & flushes 2023-07-15 22:12:44,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. after waiting 0 ms 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 687ade639d63b1796aafdbd0c79d9bfd, disabling compactions & flushes 2023-07-15 22:12:44,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. after waiting 0 ms 2023-07-15 22:12:44,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:44,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:44,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:44,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd. 2023-07-15 22:12:44,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 687ade639d63b1796aafdbd0c79d9bfd: 2023-07-15 22:12:44,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:44,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=687ade639d63b1796aafdbd0c79d9bfd, regionState=CLOSED 2023-07-15 22:12:44,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459164890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459164890"}]},"ts":"1689459164890"} 2023-07-15 22:12:44,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:44,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:44,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c. 2023-07-15 22:12:44,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f5d4ed5b128b87fee6c70ca603aafc9c: 2023-07-15 22:12:44,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-15 22:12:44,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 687ade639d63b1796aafdbd0c79d9bfd, server=jenkins-hbase4.apache.org,45299,1689459063195 in 236 msec 2023-07-15 22:12:44,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:44,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f5d4ed5b128b87fee6c70ca603aafc9c, regionState=CLOSED 2023-07-15 22:12:44,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459164897"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459164897"}]},"ts":"1689459164897"} 2023-07-15 22:12:44,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=687ade639d63b1796aafdbd0c79d9bfd, UNASSIGN in 247 msec 2023-07-15 22:12:44,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-15 22:12:44,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f5d4ed5b128b87fee6c70ca603aafc9c, server=jenkins-hbase4.apache.org,33297,1689459063148 in 244 msec 2023-07-15 22:12:44,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-15 22:12:44,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f5d4ed5b128b87fee6c70ca603aafc9c, UNASSIGN in 251 msec 2023-07-15 22:12:44,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459164902"}]},"ts":"1689459164902"} 2023-07-15 22:12:44,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 22:12:44,907 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 22:12:44,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 274 msec 2023-07-15 22:12:44,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:44,940 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 22:12:44,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,963 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,965 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,970 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,973 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,973 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,973 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,973 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,973 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:44,973 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:44,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:44,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:44,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:44,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:44,979 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,979 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,979 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,980 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,980 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,979 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,980 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:44,980 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:44,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 22:12:44,982 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/recovered.edits] 2023-07-15 22:12:44,982 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/recovered.edits] 2023-07-15 22:12:44,992 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/cf/9ada190a68a14640a0a6c14bd5b73453 2023-07-15 22:12:44,993 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/cf/d814dd1d18744d898608c722d5334322 2023-07-15 22:12:44,996 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd/recovered.edits/9.seqid 2023-07-15 22:12:44,997 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/687ade639d63b1796aafdbd0c79d9bfd 2023-07-15 22:12:44,998 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c/recovered.edits/9.seqid 2023-07-15 22:12:44,999 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f5d4ed5b128b87fee6c70ca603aafc9c 2023-07-15 22:12:44,999 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 22:12:45,000 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 22:12:45,001 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-15 22:12:45,005 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152a7b09f07f5843718ad3afb2ebd652df 2023-07-15 22:12:45,007 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715eb278c0289a2420bb370bf2782a9928d 2023-07-15 22:12:45,008 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 22:12:45,011 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:45,013 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 22:12:45,017 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 22:12:45,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:45,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 22:12:45,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459165019"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:45,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459165019"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:45,022 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:45,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f5d4ed5b128b87fee6c70ca603aafc9c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459141654.f5d4ed5b128b87fee6c70ca603aafc9c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 687ade639d63b1796aafdbd0c79d9bfd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459141654.687ade639d63b1796aafdbd0c79d9bfd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:45,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 22:12:45,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459165022"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:45,024 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 22:12:45,030 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:45,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 89 msec 2023-07-15 22:12:45,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 22:12:45,083 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 22:12:45,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 22:12:45,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:45,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 22:12:45,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:45,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 22:12:45,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:45,141 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 744) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1051699516_1 at /127.0.0.1:42892 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4222 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:46835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:42914 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:34608 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1051699516_1 at /127.0.0.1:34590 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:47524 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=515 (was 387) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=2611 (was 3461) 2023-07-15 22:12:45,141 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:45,162 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=515, ProcessCount=182, AvailableMemoryMB=2605 2023-07-15 22:12:45,162 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:45,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:12:45,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:45,167 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:45,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 22:12:45,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:45,172 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:45,180 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,180 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,183 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 empty. 2023-07-15 22:12:45,184 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 empty. 2023-07-15 22:12:45,184 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,184 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,184 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 22:12:45,209 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:45,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3198650edfc672b1d2583a3ea6d1deb3, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:45,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 56c29758f2f5279c6a8e454f1b01b3e3, NAME => 'testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3198650edfc672b1d2583a3ea6d1deb3, disabling compactions & flushes 2023-07-15 22:12:45,252 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. after waiting 0 ms 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,252 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3198650edfc672b1d2583a3ea6d1deb3: 2023-07-15 22:12:45,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 56c29758f2f5279c6a8e454f1b01b3e3, disabling compactions & flushes 2023-07-15 22:12:45,274 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. after waiting 0 ms 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,274 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,274 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 56c29758f2f5279c6a8e454f1b01b3e3: 2023-07-15 22:12:45,277 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:45,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459165278"}]},"ts":"1689459165278"} 2023-07-15 22:12:45,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459165278"}]},"ts":"1689459165278"} 2023-07-15 22:12:45,281 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:45,281 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:45,282 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459165281"}]},"ts":"1689459165281"} 2023-07-15 22:12:45,284 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 22:12:45,286 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:45,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:45,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:45,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:45,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:45,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, ASSIGN}] 2023-07-15 22:12:45,294 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, ASSIGN 2023-07-15 22:12:45,295 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:12:45,295 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, ASSIGN 2023-07-15 22:12:45,297 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45299,1689459063195; forceNewPlan=false, retain=false 2023-07-15 22:12:45,446 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:45,449 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=56c29758f2f5279c6a8e454f1b01b3e3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:45,449 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459165449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459165449"}]},"ts":"1689459165449"} 2023-07-15 22:12:45,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3198650edfc672b1d2583a3ea6d1deb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:45,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459165450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459165450"}]},"ts":"1689459165450"} 2023-07-15 22:12:45,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 56c29758f2f5279c6a8e454f1b01b3e3, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:45,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 3198650edfc672b1d2583a3ea6d1deb3, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:45,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:45,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3198650edfc672b1d2583a3ea6d1deb3, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. service=AccessControlService 2023-07-15 22:12:45,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,622 INFO [StoreOpener-3198650edfc672b1d2583a3ea6d1deb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56c29758f2f5279c6a8e454f1b01b3e3, NAME => 'testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:12:45,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. service=AccessControlService 2023-07-15 22:12:45,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:45,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:45,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,627 DEBUG [StoreOpener-3198650edfc672b1d2583a3ea6d1deb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf 2023-07-15 22:12:45,628 DEBUG [StoreOpener-3198650edfc672b1d2583a3ea6d1deb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf 2023-07-15 22:12:45,628 INFO [StoreOpener-3198650edfc672b1d2583a3ea6d1deb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3198650edfc672b1d2583a3ea6d1deb3 columnFamilyName cf 2023-07-15 22:12:45,629 INFO [StoreOpener-3198650edfc672b1d2583a3ea6d1deb3-1] regionserver.HStore(310): Store=3198650edfc672b1d2583a3ea6d1deb3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:45,633 INFO [StoreOpener-56c29758f2f5279c6a8e454f1b01b3e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,636 DEBUG [StoreOpener-56c29758f2f5279c6a8e454f1b01b3e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf 2023-07-15 22:12:45,636 DEBUG [StoreOpener-56c29758f2f5279c6a8e454f1b01b3e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf 2023-07-15 22:12:45,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:45,640 INFO [StoreOpener-56c29758f2f5279c6a8e454f1b01b3e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56c29758f2f5279c6a8e454f1b01b3e3 columnFamilyName cf 2023-07-15 22:12:45,641 INFO [StoreOpener-56c29758f2f5279c6a8e454f1b01b3e3-1] regionserver.HStore(310): Store=56c29758f2f5279c6a8e454f1b01b3e3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:45,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3198650edfc672b1d2583a3ea6d1deb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60830417, jitterRate=-0.09355615079402924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3198650edfc672b1d2583a3ea6d1deb3: 2023-07-15 22:12:45,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3., pid=94, masterSystemTime=1689459165607 2023-07-15 22:12:45,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:45,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3198650edfc672b1d2583a3ea6d1deb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:45,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:45,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459165650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459165650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459165650"}]},"ts":"1689459165650"} 2023-07-15 22:12:45,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:45,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56c29758f2f5279c6a8e454f1b01b3e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62618365, jitterRate=-0.0669136494398117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:45,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56c29758f2f5279c6a8e454f1b01b3e3: 2023-07-15 22:12:45,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 22:12:45,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 3198650edfc672b1d2583a3ea6d1deb3, server=jenkins-hbase4.apache.org,45299,1689459063195 in 196 msec 2023-07-15 22:12:45,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, ASSIGN in 365 msec 2023-07-15 22:12:45,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3., pid=93, masterSystemTime=1689459165606 2023-07-15 22:12:45,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,658 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=56c29758f2f5279c6a8e454f1b01b3e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:45,658 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459165658"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459165658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459165658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459165658"}]},"ts":"1689459165658"} 2023-07-15 22:12:45,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 22:12:45,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 56c29758f2f5279c6a8e454f1b01b3e3, server=jenkins-hbase4.apache.org,45695,1689459063074 in 209 msec 2023-07-15 22:12:45,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 22:12:45,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, ASSIGN in 373 msec 2023-07-15 22:12:45,665 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:45,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459165665"}]},"ts":"1689459165665"} 2023-07-15 22:12:45,667 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 22:12:45,669 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:45,670 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 22:12:45,672 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:45,674 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:45,674 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:45,674 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:45,674 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:45,675 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:45,675 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:45,676 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:45,676 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:45,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 512 msec 2023-07-15 22:12:45,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:45,773 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 22:12:45,788 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:45,788 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:45,791 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:45,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:45,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459165859 (current time:1689459165859). 2023-07-15 22:12:45,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:45,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x02180467 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:45,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583c1396, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:45,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:45,894 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:45,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02180467 to 127.0.0.1:53851 2023-07-15 22:12:45,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:45,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x146cbae8 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:45,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5615af3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:45,926 DEBUG [hconnection-0x6e8db6c9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:45,929 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:45,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:45,949 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:45,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x146cbae8 to 127.0.0.1:53851 2023-07-15 22:12:45,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:45,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:45,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:45,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:45,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:45,968 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:45,971 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459765971 2023-07-15 22:12:45,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:45,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:45,971 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:45,971 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:45,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:45,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:45,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-15 22:12:45,981 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:45,982 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459765982 2023-07-15 22:12:46,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,027 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 22:12:46,027 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,029 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 22:12:46,029 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:12:46,069 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,071 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,071 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:46,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:46,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:46,074 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:46,077 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,077 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,078 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,078 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,079 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,079 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,084 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,084 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,091 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,091 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,093 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,093 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,113 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,114 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,115 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,115 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,115 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,117 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,117 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383845b7[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:46,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383845b7[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:46,124 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:12:46,124 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,126 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,126 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:12:46,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,129 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,129 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,129 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,129 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,129 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,129 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:46,131 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:46,138 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:46,139 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:46,139 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:46,139 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. started... 2023-07-15 22:12:46,141 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3198650edfc672b1d2583a3ea6d1deb3: 2023-07-15 22:12:46,141 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:46,141 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. started... 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56c29758f2f5279c6a8e454f1b01b3e3: 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:46,142 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:46,210 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. completed. 2023-07-15 22:12:46,214 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:12:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,217 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,221 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. completed. 2023-07-15 22:12:46,222 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:46,222 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:46,222 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:46,222 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,222 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,222 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:12:46,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,224 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,224 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,224 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,225 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:12:46,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:12:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:12:46,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:12:46,233 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 22:12:46,233 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:46,234 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:46,234 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,234 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:46,236 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,236 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,236 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,236 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,240 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,240 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,241 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,243 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,243 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,244 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,248 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,248 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,248 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:46,251 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:12:46,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:12:46,274 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:46,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:46,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:46,276 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:46,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 22:12:46,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,431 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689459165971Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689459166274 (+303 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689459166274Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689459166274Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689459166282 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689459166321 (+39 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689459166431 (+110 ms) 2023-07-15 22:12:46,435 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:46,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 461 msec 2023-07-15 22:12:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:46,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:46,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:46,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45695] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:46,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45299] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:46,588 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:46,588 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:46,589 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:46,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:46,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459166600 (current time:1689459166600). 2023-07-15 22:12:46,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:46,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x7928aa76 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:46,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a906064, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:46,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:46,621 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7928aa76 to 127.0.0.1:53851 2023-07-15 22:12:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:46,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x59826504 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:46,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65c50f58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:46,639 DEBUG [hconnection-0x1c2fd0c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:46,640 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:46,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:46,645 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59826504 to 127.0.0.1:53851 2023-07-15 22:12:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:46,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:46,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:46,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:46,650 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:46,651 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459766651 2023-07-15 22:12:46,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:46,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:46,653 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:46,653 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:46,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:46,656 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:46,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 22:12:46,658 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:46,659 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459766659 2023-07-15 22:12:46,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,678 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 22:12:46,678 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,679 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 22:12:46,679 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:12:46,680 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,680 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,681 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,681 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:46,681 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,682 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,682 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,683 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,683 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,684 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,690 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,690 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,691 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:46,691 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:46,691 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:46,695 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,697 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,697 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,697 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,697 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,698 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:46,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:46,703 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:12:46,703 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,707 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:12:46,707 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:46,708 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. started... 2023-07-15 22:12:46,708 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3198650edfc672b1d2583a3ea6d1deb3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 22:12:46,708 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,708 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,712 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:46,712 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:46,713 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:46,713 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. started... 2023-07-15 22:12:46,713 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 56c29758f2f5279c6a8e454f1b01b3e3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 22:12:46,753 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:46,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:46,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:46,755 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:46,763 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2 2023-07-15 22:12:46,766 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2 2023-07-15 22:12:46,796 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/.tmp/cf/50dd9b8e280844ea998ce4bca114b863 2023-07-15 22:12:46,799 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/.tmp/cf/3b07055775a247329505b52804c73049 2023-07-15 22:12:46,806 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/.tmp/cf/3b07055775a247329505b52804c73049 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049 2023-07-15 22:12:46,814 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 22:12:46,815 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 56c29758f2f5279c6a8e454f1b01b3e3 in 102ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:46,815 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 22:12:46,816 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56c29758f2f5279c6a8e454f1b01b3e3: 2023-07-15 22:12:46,816 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,816 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:46,816 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049] hfiles 2023-07-15 22:12:46,816 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,825 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/.tmp/cf/50dd9b8e280844ea998ce4bca114b863 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863 2023-07-15 22:12:46,839 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863, entries=47, sequenceid=6, filesize=13.1 K 2023-07-15 22:12:46,841 INFO [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3198650edfc672b1d2583a3ea6d1deb3 in 133ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:46,851 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3198650edfc672b1d2583a3ea6d1deb3: 2023-07-15 22:12:46,852 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,853 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:46,853 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863] hfiles 2023-07-15 22:12:46,853 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,911 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. completed. 2023-07-15 22:12:46,911 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:46,912 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:46,912 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:46,912 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,912 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,912 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:12:46,914 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,914 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,914 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,914 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:12:46,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:12:46,955 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:46,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:46,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:46,957 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:46,978 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. completed. 2023-07-15 22:12:46,979 DEBUG [rs(jenkins-hbase4.apache.org,45299,1689459063195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:12:46,982 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,982 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,982 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:46,982 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:46,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45299,1689459063195': 2023-07-15 22:12:46,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:12:46,988 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 22:12:46,988 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:46,988 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:46,988 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,988 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:46,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,990 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:46,991 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:46,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,993 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:46,994 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,994 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:46,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:46,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:46,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:46,997 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:47,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:47,003 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:47,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:47,003 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:47,007 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:47,007 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:47,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:47,007 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:47,007 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:47,007 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:47,008 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:47,008 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:47,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:47,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:47,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,011 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2] mob files 2023-07-15 22:12:47,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2 2023-07-15 22:12:47,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2 2023-07-15 22:12:47,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,257 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:47,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:47,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:47,259 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 22:12:47,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 22:12:47,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,278 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689459166651Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689459167066 (+415 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689459167066Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689459167067 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689459167099 (+32 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689459167152 (+53 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689459167277 (+125 ms) 2023-07-15 22:12:47,281 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:47,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 629 msec 2023-07-15 22:12:47,759 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:47,761 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761 2023-07-15 22:12:47,762 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38251, tgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761, rawTgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:47,801 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:12:47,802 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1913591898_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:47,802 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 22:12:47,845 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:48,036 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,036 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,037 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,037 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,038 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,038 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,038 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,140 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-3409343198278391321.jar 2023-07-15 22:12:48,144 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,145 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,145 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,146 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,146 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,147 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:48,147 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:48,148 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:48,148 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:48,148 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:48,148 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:48,149 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:48,149 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:48,149 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:48,150 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:48,150 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:48,151 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:48,151 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:48,152 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:48,152 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:48,153 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:48,153 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:48,153 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:48,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:50,065 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:12:50,688 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:50,695 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 22:12:50,742 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:50,743 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:50,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0006_000001 (auth:SIMPLE) 2023-07-15 22:12:56,534 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0006_000001 (auth:SIMPLE) 2023-07-15 22:12:59,087 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:59,088 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:59,103 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:59,104 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:59,104 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:59,105 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:59,105 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 22:12:59,105 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 22:12:59,105 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:59,106 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 22:12:59,106 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459167761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 22:12:59,113 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:59,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459179119"}]},"ts":"1689459179119"} 2023-07-15 22:12:59,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 22:12:59,125 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 22:12:59,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, UNASSIGN}] 2023-07-15 22:12:59,131 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, UNASSIGN 2023-07-15 22:12:59,132 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=56c29758f2f5279c6a8e454f1b01b3e3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:59,132 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459179132"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459179132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459179132"}]},"ts":"1689459179132"} 2023-07-15 22:12:59,133 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, UNASSIGN 2023-07-15 22:12:59,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 56c29758f2f5279c6a8e454f1b01b3e3, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:59,135 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3198650edfc672b1d2583a3ea6d1deb3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:12:59,136 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459179135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459179135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459179135"}]},"ts":"1689459179135"} 2023-07-15 22:12:59,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 3198650edfc672b1d2583a3ea6d1deb3, server=jenkins-hbase4.apache.org,45299,1689459063195}] 2023-07-15 22:12:59,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:59,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:59,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56c29758f2f5279c6a8e454f1b01b3e3, disabling compactions & flushes 2023-07-15 22:12:59,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:59,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:59,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. after waiting 0 ms 2023-07-15 22:12:59,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:59,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:59,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3198650edfc672b1d2583a3ea6d1deb3, disabling compactions & flushes 2023-07-15 22:12:59,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:59,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:59,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. after waiting 0 ms 2023-07-15 22:12:59,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:59,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:59,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:59,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:59,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3. 2023-07-15 22:12:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3198650edfc672b1d2583a3ea6d1deb3: 2023-07-15 22:12:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:59,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3. 2023-07-15 22:12:59,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56c29758f2f5279c6a8e454f1b01b3e3: 2023-07-15 22:12:59,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:59,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3198650edfc672b1d2583a3ea6d1deb3, regionState=CLOSED 2023-07-15 22:12:59,312 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459179311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459179311"}]},"ts":"1689459179311"} 2023-07-15 22:12:59,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:59,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=56c29758f2f5279c6a8e454f1b01b3e3, regionState=CLOSED 2023-07-15 22:12:59,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459179312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459179312"}]},"ts":"1689459179312"} 2023-07-15 22:12:59,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 22:12:59,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 3198650edfc672b1d2583a3ea6d1deb3, server=jenkins-hbase4.apache.org,45299,1689459063195 in 176 msec 2023-07-15 22:12:59,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 22:12:59,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 56c29758f2f5279c6a8e454f1b01b3e3, server=jenkins-hbase4.apache.org,45695,1689459063074 in 180 msec 2023-07-15 22:12:59,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3198650edfc672b1d2583a3ea6d1deb3, UNASSIGN in 190 msec 2023-07-15 22:12:59,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-15 22:12:59,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=56c29758f2f5279c6a8e454f1b01b3e3, UNASSIGN in 190 msec 2023-07-15 22:12:59,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459179317"}]},"ts":"1689459179317"} 2023-07-15 22:12:59,319 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 22:12:59,320 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 22:12:59,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 209 msec 2023-07-15 22:12:59,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:59,422 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 22:12:59,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,427 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,429 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,431 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:59,431 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:59,433 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/recovered.edits] 2023-07-15 22:12:59,433 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/recovered.edits] 2023-07-15 22:12:59,437 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,437 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,437 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,438 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 22:12:59,439 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,439 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:59,439 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:59,439 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:59,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-15 22:12:59,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-15 22:12:59,439 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:12:59,439 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:12:59,440 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-15 22:12:59,440 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:12:59,440 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:59,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 22:12:59,442 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/cf/50dd9b8e280844ea998ce4bca114b863 2023-07-15 22:12:59,443 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/cf/3b07055775a247329505b52804c73049 2023-07-15 22:12:59,446 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3/recovered.edits/9.seqid 2023-07-15 22:12:59,447 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3/recovered.edits/9.seqid 2023-07-15 22:12:59,447 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/3198650edfc672b1d2583a3ea6d1deb3 2023-07-15 22:12:59,447 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testEmptyExportFileSystemState/56c29758f2f5279c6a8e454f1b01b3e3 2023-07-15 22:12:59,447 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 22:12:59,447 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 22:12:59,448 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-15 22:12:59,451 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071555ac131e91254bf3913da3e06609fae2 2023-07-15 22:12:59,453 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307151919901c5f9c44b4ab4e5223d2efe3b2 2023-07-15 22:12:59,453 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 22:12:59,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,457 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 22:12:59,459 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 22:12:59,460 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,460 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 22:12:59,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459179460"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:59,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459179460"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:59,462 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:59,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 56c29758f2f5279c6a8e454f1b01b3e3, NAME => 'testtb-testEmptyExportFileSystemState,,1689459165164.56c29758f2f5279c6a8e454f1b01b3e3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3198650edfc672b1d2583a3ea6d1deb3, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459165164.3198650edfc672b1d2583a3ea6d1deb3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:59,462 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 22:12:59,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459179462"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:59,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 22:12:59,465 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:59,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 42 msec 2023-07-15 22:12:59,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 22:12:59,543 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 22:12:59,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 22:12:59,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:59,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 22:12:59,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:59,583 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 760), OpenFileDescriptor=928 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=609 (was 515) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=1860 (was 2605) 2023-07-15 22:12:59,583 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:59,610 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=609, ProcessCount=182, AvailableMemoryMB=1860 2023-07-15 22:12:59,610 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:59,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 22:12:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:59,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:59,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 22:12:59,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:59,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:59,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:12:59,619 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:12:59,620 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 empty. 2023-07-15 22:12:59,620 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 empty. 2023-07-15 22:12:59,621 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:12:59,621 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:12:59,621 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 22:12:59,642 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:59,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f05eb61564be39fd07152aeda527690, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:59,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d78aa97282d526b971ec42d231de7a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp 2023-07-15 22:12:59,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:59,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 2f05eb61564be39fd07152aeda527690, disabling compactions & flushes 2023-07-15 22:12:59,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:12:59,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:12:59,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. after waiting 0 ms 2023-07-15 22:12:59,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:12:59,712 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:12:59,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 2f05eb61564be39fd07152aeda527690: 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 9d78aa97282d526b971ec42d231de7a6, disabling compactions & flushes 2023-07-15 22:12:59,713 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. after waiting 0 ms 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:12:59,713 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:12:59,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 9d78aa97282d526b971ec42d231de7a6: 2023-07-15 22:12:59,715 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:59,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459179716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459179716"}]},"ts":"1689459179716"} 2023-07-15 22:12:59,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459179716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459179716"}]},"ts":"1689459179716"} 2023-07-15 22:12:59,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:59,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:59,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:59,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459179720"}]},"ts":"1689459179720"} 2023-07-15 22:12:59,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 22:12:59,726 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:59,727 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:59,727 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:59,727 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:59,727 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:59,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, ASSIGN}] 2023-07-15 22:12:59,730 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, ASSIGN 2023-07-15 22:12:59,731 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, ASSIGN 2023-07-15 22:12:59,731 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689459063148; forceNewPlan=false, retain=false 2023-07-15 22:12:59,731 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45695,1689459063074; forceNewPlan=false, retain=false 2023-07-15 22:12:59,882 INFO [jenkins-hbase4:41943] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:59,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2f05eb61564be39fd07152aeda527690, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:12:59,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459179885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459179885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459179885"}]},"ts":"1689459179885"} 2023-07-15 22:12:59,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9d78aa97282d526b971ec42d231de7a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:12:59,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459179886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459179886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459179886"}]},"ts":"1689459179886"} 2023-07-15 22:12:59,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 2f05eb61564be39fd07152aeda527690, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:12:59,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 9d78aa97282d526b971ec42d231de7a6, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:12:59,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:13:00,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f05eb61564be39fd07152aeda527690, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:13:00,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. service=AccessControlService 2023-07-15 22:13:00,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:13:00,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:13:00,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,052 INFO [StoreOpener-2f05eb61564be39fd07152aeda527690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d78aa97282d526b971ec42d231de7a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. service=AccessControlService 2023-07-15 22:13:00,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,055 DEBUG [StoreOpener-2f05eb61564be39fd07152aeda527690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf 2023-07-15 22:13:00,055 DEBUG [StoreOpener-2f05eb61564be39fd07152aeda527690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf 2023-07-15 22:13:00,056 INFO [StoreOpener-2f05eb61564be39fd07152aeda527690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f05eb61564be39fd07152aeda527690 columnFamilyName cf 2023-07-15 22:13:00,057 INFO [StoreOpener-2f05eb61564be39fd07152aeda527690-1] regionserver.HStore(310): Store=2f05eb61564be39fd07152aeda527690/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:13:00,063 INFO [StoreOpener-9d78aa97282d526b971ec42d231de7a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,066 DEBUG [StoreOpener-9d78aa97282d526b971ec42d231de7a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf 2023-07-15 22:13:00,067 DEBUG [StoreOpener-9d78aa97282d526b971ec42d231de7a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf 2023-07-15 22:13:00,067 INFO [StoreOpener-9d78aa97282d526b971ec42d231de7a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d78aa97282d526b971ec42d231de7a6 columnFamilyName cf 2023-07-15 22:13:00,068 INFO [StoreOpener-9d78aa97282d526b971ec42d231de7a6-1] regionserver.HStore(310): Store=9d78aa97282d526b971ec42d231de7a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:13:00,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:00,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:00,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:13:00,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f05eb61564be39fd07152aeda527690; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59931941, jitterRate=-0.1069444864988327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:13:00,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f05eb61564be39fd07152aeda527690: 2023-07-15 22:13:00,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690., pid=108, masterSystemTime=1689459180043 2023-07-15 22:13:00,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:13:00,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d78aa97282d526b971ec42d231de7a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64171710, jitterRate=-0.04376700520515442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:13:00,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d78aa97282d526b971ec42d231de7a6: 2023-07-15 22:13:00,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6., pid=109, masterSystemTime=1689459180046 2023-07-15 22:13:00,077 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2f05eb61564be39fd07152aeda527690, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,077 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459180077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459180077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459180077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459180077"}]},"ts":"1689459180077"} 2023-07-15 22:13:00,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,079 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9d78aa97282d526b971ec42d231de7a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,079 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459180079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459180079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459180079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459180079"}]},"ts":"1689459180079"} 2023-07-15 22:13:00,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 22:13:00,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 2f05eb61564be39fd07152aeda527690, server=jenkins-hbase4.apache.org,45695,1689459063074 in 187 msec 2023-07-15 22:13:00,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 22:13:00,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 9d78aa97282d526b971ec42d231de7a6, server=jenkins-hbase4.apache.org,33297,1689459063148 in 187 msec 2023-07-15 22:13:00,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, ASSIGN in 354 msec 2023-07-15 22:13:00,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-15 22:13:00,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, ASSIGN in 356 msec 2023-07-15 22:13:00,086 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:13:00,086 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459180086"}]},"ts":"1689459180086"} 2023-07-15 22:13:00,087 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 22:13:00,090 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:13:00,090 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 22:13:00,092 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:13:00,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:00,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:00,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:00,093 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:00,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:13:00,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:13:00,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:13:00,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:13:00,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 483 msec 2023-07-15 22:13:00,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:13:00,222 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 22:13:00,224 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,224 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,226 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:13:00,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459180252 (current time:1689459180252). 2023-07-15 22:13:00,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:13:00,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x1f2e2c01 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:13:00,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d4ef4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:13:00,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,269 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f2e2c01 to 127.0.0.1:53851 2023-07-15 22:13:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x365ac488 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:13:00,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@587aa866, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:13:00,293 DEBUG [hconnection-0x1a9692b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,297 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,305 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x365ac488 to 127.0.0.1:53851 2023-07-15 22:13:00,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:00,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:13:00,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:13:00,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,311 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,311 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689459780311 2023-07-15 22:13:00,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,318 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:13:00,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:00,318 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:13:00,318 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-15 22:13:00,320 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:00,321 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689459780321 2023-07-15 22:13:00,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,353 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:13:00,353 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,355 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 22:13:00,355 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 22:13:00,410 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,410 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,413 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,413 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,413 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,413 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:13:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,414 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,415 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:13:00,417 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,417 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,417 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,417 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,418 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:13:00,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:13:00,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:13:00,423 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:13:00,427 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,429 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 1] remaining members to acquire global barrier 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:13:00,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 0] remaining members to acquire global barrier 2023-07-15 22:13:00,435 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 22:13:00,435 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:13:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,439 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,443 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:13:00,443 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:13:00,443 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,443 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,443 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. started... 2023-07-15 22:13:00,446 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:13:00,452 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:13:00,452 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,452 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. started... 2023-07-15 22:13:00,452 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d78aa97282d526b971ec42d231de7a6: 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:13:00,452 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f05eb61564be39fd07152aeda527690: 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:13:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:13:00,453 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,453 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:13:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,488 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. completed. 2023-07-15 22:13:00,489 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,489 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:13:00,489 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:13:00,489 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,489 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,489 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:13:00,491 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. completed. 2023-07-15 22:13:00,491 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,491 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:13:00,492 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,496 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:13:00,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 22:13:00,505 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 22:13:00,505 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:13:00,505 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:13:00,505 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,505 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,507 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,508 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,509 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,509 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,511 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,512 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,512 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,515 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,515 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:13:00,517 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,518 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,518 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,518 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,518 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,518 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 22:13:00,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 22:13:00,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,602 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689459180312Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689459180537 (+225 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459180537Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459180537Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459180541 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459180563 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689459180601 (+38 ms) 2023-07-15 22:13:00,605 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:00,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 289 msec 2023-07-15 22:13:00,623 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:13:00,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:13:00,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:13:00,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:13:00,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45695] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:13:00,631 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,631 DEBUG [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,631 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:13:00,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459180643 (current time:1689459180643). 2023-07-15 22:13:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:13:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x17fd93d6 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:13:00,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3950c0c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:13:00,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,664 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17fd93d6 to 127.0.0.1:53851 2023-07-15 22:13:00,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:00,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(139): Connect 0x2e73a946 to 127.0.0.1:53851 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:13:00,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55ebfc7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:13:00,681 DEBUG [hconnection-0x6a8278db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,684 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:13:00,693 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:13:00,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e73a946 to 127.0.0.1:53851 2023-07-15 22:13:00,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:00,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:13:00,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:13:00,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,699 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,700 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689459780700 2023-07-15 22:13:00,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:13:00,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:13:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:13:00,702 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:13:00,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:00,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-15 22:13:00,706 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:00,707 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689459780706 2023-07-15 22:13:00,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,723 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:13:00,723 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,725 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 22:13:00,725 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 22:13:00,726 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,726 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,728 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,728 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,728 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,729 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,729 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,729 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,730 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:13:00,730 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,732 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,732 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,732 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,732 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,732 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,733 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,733 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45695,1689459063074' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:13:00,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681d762a[Count = 1] remaining members to acquire global barrier 2023-07-15 22:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45299,1689459063195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:13:00,741 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:13:00,741 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:13:00,741 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:13:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,743 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,744 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,743 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689459063148' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:13:00,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681d762a[Count = 0] remaining members to acquire global barrier 2023-07-15 22:13:00,746 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 22:13:00,746 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,752 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:13:00,753 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,753 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,753 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. started... 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45299,1689459063195' in zk 2023-07-15 22:13:00,753 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. started... 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:13:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:13:00,753 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,753 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f05eb61564be39fd07152aeda527690 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 22:13:00,753 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:13:00,753 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d78aa97282d526b971ec42d231de7a6 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 22:13:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,755 DEBUG [member: 'jenkins-hbase4.apache.org,45299,1689459063195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,801 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:13:00,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:13:00,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:13:00,802 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:13:00,812 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700 2023-07-15 22:13:00,814 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca 2023-07-15 22:13:00,831 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/.tmp/cf/622c33510d574d0fa707fc02d956445e 2023-07-15 22:13:00,837 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/.tmp/cf/622c33510d574d0fa707fc02d956445e as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e 2023-07-15 22:13:00,838 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/.tmp/cf/72b6d2a190b64bbd85bd899097bed1dc 2023-07-15 22:13:00,842 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e, entries=46, sequenceid=6, filesize=13.2 K 2023-07-15 22:13:00,842 INFO [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2f05eb61564be39fd07152aeda527690 in 89ms, sequenceid=6, compaction requested=false 2023-07-15 22:13:00,843 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:13:00,843 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f05eb61564be39fd07152aeda527690: 2023-07-15 22:13:00,843 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,843 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:13:00,844 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e] hfiles 2023-07-15 22:13:00,844 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,847 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/.tmp/cf/72b6d2a190b64bbd85bd899097bed1dc as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc 2023-07-15 22:13:00,852 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 22:13:00,853 INFO [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9d78aa97282d526b971ec42d231de7a6 in 100ms, sequenceid=6, compaction requested=false 2023-07-15 22:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d78aa97282d526b971ec42d231de7a6: 2023-07-15 22:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc] hfiles 2023-07-15 22:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,887 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. completed. 2023-07-15 22:13:00,887 DEBUG [rs(jenkins-hbase4.apache.org,45695,1689459063074)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:13:00,888 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:13:00,888 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45695,1689459063074' in zk 2023-07-15 22:13:00,893 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,893 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,893 DEBUG [member: 'jenkins-hbase4.apache.org,45695,1689459063074' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,894 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,899 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. completed. 2023-07-15 22:13:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,899 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689459063148)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:13:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:13:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:13:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33297,1689459063148' in zk 2023-07-15 22:13:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,901 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,901 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:13:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,901 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,901 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689459063148' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:13:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45695,1689459063074': 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45695,1689459063074' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33297,1689459063148': 2023-07-15 22:13:00,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689459063148' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 22:13:00,909 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 22:13:00,909 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:13:00,909 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:13:00,909 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,909 INFO [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,912 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,912 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,913 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,913 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:13:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,915 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,916 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,916 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,918 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,919 DEBUG [(jenkins-hbase4.apache.org,41943,1689459061444)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:13:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:13:00,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:13:00,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,919 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,919 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,919 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:13:00,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 22:13:00,920 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,921 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,921 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,921 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,921 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,921 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:00,922 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,922 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:00,922 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:00,922 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,922 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca] mob files 2023-07-15 22:13:00,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700 2023-07-15 22:13:00,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:13:00,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca 2023-07-15 22:13:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:13:00,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:00,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:01,003 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:13:01,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:13:01,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:13:01,004 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:13:01,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 22:13:01,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:01,031 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:01,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689459180700Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689459180934 (+234 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689459180934Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689459180934Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689459180946 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689459180975 (+29 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689459181030 (+55 ms) 2023-07-15 22:13:01,034 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:13:01,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 332 msec 2023-07-15 22:13:01,304 DEBUG [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:13:01,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:13:01,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:13:01,306 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306 2023-07-15 22:13:01,306 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38251, tgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306, rawTgtDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306, srcFsUri=hdfs://localhost:38251, srcDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:13:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008 2023-07-15 22:13:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1205448189_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:01,328 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38251, inputRoot=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008, snapshotDir=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 22:13:01,384 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:01,530 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,530 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,531 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,531 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,532 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,532 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,532 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,621 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/hadoop-3779811719975667868.jar 2023-07-15 22:13:01,622 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,622 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,623 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,623 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,623 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,624 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:13:01,624 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:13:01,625 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:13:01,625 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:13:01,626 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:13:01,626 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:13:01,627 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:13:01,627 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:13:01,628 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:13:01,628 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:13:01,628 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:13:01,629 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:13:01,629 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:13:01,630 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:13:01,630 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:13:01,630 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:13:01,631 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:13:01,631 DEBUG [Listener at jenkins-hbase4.apache.org/34497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:13:02,743 WARN [Listener at jenkins-hbase4.apache.org/34497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:13:02,745 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 22:13:02,747 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-15 22:13:03,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:13:03,946 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:13:03,950 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0006_000001 (auth:SIMPLE) 2023-07-15 22:13:04,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:04,898 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:13:10,788 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:13,025 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:17,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:19,043 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:13:19,043 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:13:19,060 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,060 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:13:19,061 INFO [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:13:19,061 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,062 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 22:13:19,062 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 22:13:19,062 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1438918492_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,062 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 22:13:19,062 DEBUG [Listener at jenkins-hbase4.apache.org/34497] snapshot.TestExportSnapshot(367): hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/export-test/export-1689459181306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 22:13:19,068 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:19,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459199073"}]},"ts":"1689459199073"} 2023-07-15 22:13:19,075 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 22:13:19,076 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 22:13:19,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, UNASSIGN}] 2023-07-15 22:13:19,079 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, UNASSIGN 2023-07-15 22:13:19,079 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, UNASSIGN 2023-07-15 22:13:19,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9d78aa97282d526b971ec42d231de7a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:19,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2f05eb61564be39fd07152aeda527690, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:19,080 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459199080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459199080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459199080"}]},"ts":"1689459199080"} 2023-07-15 22:13:19,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459199080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459199080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459199080"}]},"ts":"1689459199080"} 2023-07-15 22:13:19,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 9d78aa97282d526b971ec42d231de7a6, server=jenkins-hbase4.apache.org,33297,1689459063148}] 2023-07-15 22:13:19,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 2f05eb61564be39fd07152aeda527690, server=jenkins-hbase4.apache.org,45695,1689459063074}] 2023-07-15 22:13:19,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:19,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:19,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d78aa97282d526b971ec42d231de7a6, disabling compactions & flushes 2023-07-15 22:13:19,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:19,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:19,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. after waiting 0 ms 2023-07-15 22:13:19,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:19,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:19,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f05eb61564be39fd07152aeda527690, disabling compactions & flushes 2023-07-15 22:13:19,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:19,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:19,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. after waiting 0 ms 2023-07-15 22:13:19,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:19,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:19,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:19,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6. 2023-07-15 22:13:19,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d78aa97282d526b971ec42d231de7a6: 2023-07-15 22:13:19,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:19,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9d78aa97282d526b971ec42d231de7a6, regionState=CLOSED 2023-07-15 22:13:19,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459199263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459199263"}]},"ts":"1689459199263"} 2023-07-15 22:13:19,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:19,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:19,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690. 2023-07-15 22:13:19,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f05eb61564be39fd07152aeda527690: 2023-07-15 22:13:19,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:19,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2f05eb61564be39fd07152aeda527690, regionState=CLOSED 2023-07-15 22:13:19,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459199270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459199270"}]},"ts":"1689459199270"} 2023-07-15 22:13:19,272 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-15 22:13:19,272 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 9d78aa97282d526b971ec42d231de7a6, server=jenkins-hbase4.apache.org,33297,1689459063148 in 188 msec 2023-07-15 22:13:19,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9d78aa97282d526b971ec42d231de7a6, UNASSIGN in 195 msec 2023-07-15 22:13:19,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-15 22:13:19,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 2f05eb61564be39fd07152aeda527690, server=jenkins-hbase4.apache.org,45695,1689459063074 in 190 msec 2023-07-15 22:13:19,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 22:13:19,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2f05eb61564be39fd07152aeda527690, UNASSIGN in 198 msec 2023-07-15 22:13:19,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459199277"}]},"ts":"1689459199277"} 2023-07-15 22:13:19,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 22:13:19,281 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 22:13:19,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 212 msec 2023-07-15 22:13:19,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:19,376 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 22:13:19,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,380 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,381 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,382 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,386 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,386 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,386 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:19,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:19,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:19,387 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:19,389 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:19,389 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:19,389 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:19,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 22:13:19,391 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/recovered.edits] 2023-07-15 22:13:19,392 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf, FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/recovered.edits] 2023-07-15 22:13:19,396 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/cf/72b6d2a190b64bbd85bd899097bed1dc 2023-07-15 22:13:19,396 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/cf/622c33510d574d0fa707fc02d956445e 2023-07-15 22:13:19,399 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690/recovered.edits/9.seqid 2023-07-15 22:13:19,399 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/recovered.edits/9.seqid to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6/recovered.edits/9.seqid 2023-07-15 22:13:19,399 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2f05eb61564be39fd07152aeda527690 2023-07-15 22:13:19,399 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9d78aa97282d526b971ec42d231de7a6 2023-07-15 22:13:19,400 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 22:13:19,400 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 22:13:19,401 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-15 22:13:19,405 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700 to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071551943c6c4b4f46dd90b753a4cd566700 2023-07-15 22:13:19,407 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca to hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071590e5a504889241d49ff0eebcdfa543ca 2023-07-15 22:13:19,407 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 22:13:19,409 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,411 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 22:13:19,413 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 22:13:19,414 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,414 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 22:13:19,414 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459199414"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:19,414 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459199414"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:19,419 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:13:19,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9d78aa97282d526b971ec42d231de7a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459179612.9d78aa97282d526b971ec42d231de7a6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2f05eb61564be39fd07152aeda527690, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459179612.2f05eb61564be39fd07152aeda527690.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:13:19,419 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 22:13:19,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459199419"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:19,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 22:13:19,425 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 48 msec 2023-07-15 22:13:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 22:13:19,491 INFO [Listener at jenkins-hbase4.apache.org/34497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 22:13:19,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 22:13:19,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 22:13:19,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41943] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:19,535 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5664 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x73a83cd-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_741712294_1 at /127.0.0.1:49022 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:49042 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:44190 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1438918492_17 at /127.0.0.1:49458 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_741712294_1 at /127.0.0.1:44160 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:36689 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=924 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=575 (was 609), ProcessCount=179 (was 182), AvailableMemoryMB=1788 (was 1860) 2023-07-15 22:13:19,535 WARN [Listener at jenkins-hbase4.apache.org/34497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 22:13:19,535 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 22:13:19,549 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:23,290 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459072256_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:24,829 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:13:33,677 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:47,793 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:47,793 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:47,903 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 22:13:47,910 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 22:13:47,912 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:47,961 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:48,066 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:48,066 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 22:13:48,067 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 22:13:48,067 INFO [Listener at jenkins-hbase4.apache.org/34497] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 22:13:48,067 DEBUG [Listener at jenkins-hbase4.apache.org/34497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66ff428c to 127.0.0.1:53851 2023-07-15 22:13:48,067 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,067 DEBUG [Listener at jenkins-hbase4.apache.org/34497] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 22:13:48,067 DEBUG [Listener at jenkins-hbase4.apache.org/34497] util.JVMClusterUtil(257): Found active master hash=2053498703, stopped=false 2023-07-15 22:13:48,067 DEBUG [Listener at jenkins-hbase4.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,068 DEBUG [Listener at jenkins-hbase4.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 22:13:48,068 INFO [Listener at jenkins-hbase4.apache.org/34497] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:13:48,090 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:48,090 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:48,091 INFO [Listener at jenkins-hbase4.apache.org/34497] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 22:13:48,091 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:13:48,090 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:48,091 DEBUG [Listener at jenkins-hbase4.apache.org/34497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dd40eb5 to 127.0.0.1:53851 2023-07-15 22:13:48,091 DEBUG [Listener at jenkins-hbase4.apache.org/34497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,090 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:48,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:48,091 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45695,1689459063074' ***** 2023-07-15 22:13:48,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:48,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:48,092 DEBUG [Listener at jenkins-hbase4.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,092 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:48,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:48,092 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33297,1689459063148' ***** 2023-07-15 22:13:48,092 INFO [RS:0;jenkins-hbase4:45695] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:48,092 DEBUG [Listener at jenkins-hbase4.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,092 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:48,092 INFO [RS:0;jenkins-hbase4:45695] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:48,092 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:48,092 INFO [RS:0;jenkins-hbase4:45695] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:48,093 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(3305): Received CLOSE for d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:13:48,093 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:48,093 DEBUG [RS:0;jenkins-hbase4:45695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c9fc559 to 127.0.0.1:53851 2023-07-15 22:13:48,093 DEBUG [RS:0;jenkins-hbase4:45695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,092 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45299,1689459063195' ***** 2023-07-15 22:13:48,096 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 22:13:48,096 DEBUG [Listener at jenkins-hbase4.apache.org/34497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d18205c94a8d73949a3f6cda81c1f529, disabling compactions & flushes 2023-07-15 22:13:48,092 INFO [RS:1;jenkins-hbase4:33297] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:48,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:13:48,097 INFO [RS:1;jenkins-hbase4:33297] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:48,097 INFO [RS:1;jenkins-hbase4:33297] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:48,097 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(3305): Received CLOSE for ded3f87c2067dd2a2293834e60744889 2023-07-15 22:13:48,097 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:48,097 DEBUG [RS:1;jenkins-hbase4:33297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c545539 to 127.0.0.1:53851 2023-07-15 22:13:48,097 INFO [Listener at jenkins-hbase4.apache.org/34497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:48,097 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1478): Online Regions={d18205c94a8d73949a3f6cda81c1f529=hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529.} 2023-07-15 22:13:48,098 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,098 DEBUG [RS:1;jenkins-hbase4:33297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ded3f87c2067dd2a2293834e60744889, disabling compactions & flushes 2023-07-15 22:13:48,098 INFO [RS:2;jenkins-hbase4:45299] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:48,098 INFO [RS:2;jenkins-hbase4:45299] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:48,097 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:13:48,099 INFO [RS:2;jenkins-hbase4:45299] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:48,098 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:48,099 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 22:13:48,099 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1478): Online Regions={ded3f87c2067dd2a2293834e60744889=hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889.} 2023-07-15 22:13:48,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:13:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:13:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. after waiting 0 ms 2023-07-15 22:13:48,099 DEBUG [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1504): Waiting on ded3f87c2067dd2a2293834e60744889 2023-07-15 22:13:48,099 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. after waiting 0 ms 2023-07-15 22:13:48,099 DEBUG [RS:2;jenkins-hbase4:45299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x073fd2ba to 127.0.0.1:53851 2023-07-15 22:13:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:13:48,100 DEBUG [RS:2;jenkins-hbase4:45299] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:13:48,099 DEBUG [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1504): Waiting on d18205c94a8d73949a3f6cda81c1f529 2023-07-15 22:13:48,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ded3f87c2067dd2a2293834e60744889 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 22:13:48,100 INFO [RS:2;jenkins-hbase4:45299] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:48,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d18205c94a8d73949a3f6cda81c1f529 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 22:13:48,100 INFO [RS:2;jenkins-hbase4:45299] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:48,100 INFO [RS:2;jenkins-hbase4:45299] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:48,100 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 22:13:48,103 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,107 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 22:13:48,107 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-15 22:13:48,107 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 22:13:48,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 22:13:48,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 22:13:48,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 22:13:48,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 22:13:48,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 22:13:48,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 22:13:48,119 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 22:13:48,120 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 22:13:48,168 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 22:13:48,168 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 22:13:48,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/.tmp/info/3fa29557e3204310861556a2c3b38f34 2023-07-15 22:13:48,180 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/info/a560b3f5742941888e46886b1b248001 2023-07-15 22:13:48,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/.tmp/l/a8764d0e2a004824b3b810a912f7a775 2023-07-15 22:13:48,193 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 22:13:48,193 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 22:13:48,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/.tmp/info/3fa29557e3204310861556a2c3b38f34 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/info/3fa29557e3204310861556a2c3b38f34 2023-07-15 22:13:48,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8764d0e2a004824b3b810a912f7a775 2023-07-15 22:13:48,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a560b3f5742941888e46886b1b248001 2023-07-15 22:13:48,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/.tmp/l/a8764d0e2a004824b3b810a912f7a775 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/l/a8764d0e2a004824b3b810a912f7a775 2023-07-15 22:13:48,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8764d0e2a004824b3b810a912f7a775 2023-07-15 22:13:48,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/l/a8764d0e2a004824b3b810a912f7a775, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 22:13:48,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ded3f87c2067dd2a2293834e60744889 in 115ms, sequenceid=18, compaction requested=false 2023-07-15 22:13:48,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/info/3fa29557e3204310861556a2c3b38f34, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 22:13:48,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d18205c94a8d73949a3f6cda81c1f529 in 117ms, sequenceid=6, compaction requested=false 2023-07-15 22:13:48,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/acl/ded3f87c2067dd2a2293834e60744889/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 22:13:48,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/namespace/d18205c94a8d73949a3f6cda81c1f529/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:48,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:13:48,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ded3f87c2067dd2a2293834e60744889: 2023-07-15 22:13:48,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689459066896.ded3f87c2067dd2a2293834e60744889. 2023-07-15 22:13:48,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:13:48,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d18205c94a8d73949a3f6cda81c1f529: 2023-07-15 22:13:48,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689459066046.d18205c94a8d73949a3f6cda81c1f529. 2023-07-15 22:13:48,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/rep_barrier/91a509068a2e419f89342097385fa055 2023-07-15 22:13:48,300 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33297,1689459063148; all regions closed. 2023-07-15 22:13:48,300 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45695,1689459063074; all regions closed. 2023-07-15 22:13:48,309 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91a509068a2e419f89342097385fa055 2023-07-15 22:13:48,312 DEBUG [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 22:13:48,335 DEBUG [RS:0;jenkins-hbase4:45695] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs 2023-07-15 22:13:48,335 INFO [RS:0;jenkins-hbase4:45695] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45695%2C1689459063074:(num 1689459065326) 2023-07-15 22:13:48,335 DEBUG [RS:0;jenkins-hbase4:45695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,335 INFO [RS:0;jenkins-hbase4:45695] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,336 DEBUG [RS:1;jenkins-hbase4:33297] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs 2023-07-15 22:13:48,336 INFO [RS:1;jenkins-hbase4:33297] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33297%2C1689459063148:(num 1689459065325) 2023-07-15 22:13:48,336 DEBUG [RS:1;jenkins-hbase4:33297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,336 INFO [RS:1;jenkins-hbase4:33297] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,336 INFO [RS:0;jenkins-hbase4:45695] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:48,336 INFO [RS:0;jenkins-hbase4:45695] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:48,336 INFO [RS:0;jenkins-hbase4:45695] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:48,336 INFO [RS:0;jenkins-hbase4:45695] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:48,336 INFO [RS:1;jenkins-hbase4:33297] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:48,341 INFO [RS:1;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:48,341 INFO [RS:0;jenkins-hbase4:45695] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45695 2023-07-15 22:13:48,341 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:48,341 INFO [RS:1;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:48,343 INFO [RS:1;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:48,342 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:48,356 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:48,357 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:48,357 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:48,357 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:48,360 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:48,357 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45695,1689459063074 2023-07-15 22:13:48,360 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:48,358 INFO [RS:1;jenkins-hbase4:33297] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33297 2023-07-15 22:13:48,362 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:48,362 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33297,1689459063148 2023-07-15 22:13:48,362 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45695,1689459063074] 2023-07-15 22:13:48,364 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45695,1689459063074; numProcessing=1 2023-07-15 22:13:48,369 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45695,1689459063074 already deleted, retry=false 2023-07-15 22:13:48,369 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45695,1689459063074 expired; onlineServers=2 2023-07-15 22:13:48,369 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33297,1689459063148] 2023-07-15 22:13:48,369 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33297,1689459063148; numProcessing=2 2023-07-15 22:13:48,371 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33297,1689459063148 already deleted, retry=false 2023-07-15 22:13:48,371 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33297,1689459063148 expired; onlineServers=1 2023-07-15 22:13:48,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/table/4aa84e0b2ec947a7ab435d210361e1b4 2023-07-15 22:13:48,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa84e0b2ec947a7ab435d210361e1b4 2023-07-15 22:13:48,402 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/info/a560b3f5742941888e46886b1b248001 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/info/a560b3f5742941888e46886b1b248001 2023-07-15 22:13:48,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a560b3f5742941888e46886b1b248001 2023-07-15 22:13:48,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/info/a560b3f5742941888e46886b1b248001, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 22:13:48,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/rep_barrier/91a509068a2e419f89342097385fa055 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/rep_barrier/91a509068a2e419f89342097385fa055 2023-07-15 22:13:48,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91a509068a2e419f89342097385fa055 2023-07-15 22:13:48,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/rep_barrier/91a509068a2e419f89342097385fa055, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 22:13:48,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/.tmp/table/4aa84e0b2ec947a7ab435d210361e1b4 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/table/4aa84e0b2ec947a7ab435d210361e1b4 2023-07-15 22:13:48,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aa84e0b2ec947a7ab435d210361e1b4 2023-07-15 22:13:48,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/table/4aa84e0b2ec947a7ab435d210361e1b4, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 22:13:48,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 319ms, sequenceid=131, compaction requested=false 2023-07-15 22:13:48,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 22:13:48,461 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,461 INFO [RS:0;jenkins-hbase4:45695] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45695,1689459063074; zookeeper connection closed. 2023-07-15 22:13:48,462 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45695-0x1016b09f22c0001, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:48,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 22:13:48,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 22:13:48,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 22:13:48,471 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@757ca16] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@757ca16 2023-07-15 22:13:48,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 22:13:48,512 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45299,1689459063195; all regions closed. 2023-07-15 22:13:48,523 DEBUG [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs 2023-07-15 22:13:48,523 INFO [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45299%2C1689459063195.meta:.meta(num 1689459065647) 2023-07-15 22:13:48,532 DEBUG [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/oldWALs 2023-07-15 22:13:48,532 INFO [RS:2;jenkins-hbase4:45299] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45299%2C1689459063195:(num 1689459065329) 2023-07-15 22:13:48,532 DEBUG [RS:2;jenkins-hbase4:45299] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,532 INFO [RS:2;jenkins-hbase4:45299] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:48,534 INFO [RS:2;jenkins-hbase4:45299] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:48,535 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:48,536 INFO [RS:2;jenkins-hbase4:45299] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45299 2023-07-15 22:13:48,538 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:48,538 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45299,1689459063195 2023-07-15 22:13:48,539 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45299,1689459063195] 2023-07-15 22:13:48,539 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45299,1689459063195; numProcessing=3 2023-07-15 22:13:48,542 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45299,1689459063195 already deleted, retry=false 2023-07-15 22:13:48,542 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45299,1689459063195 expired; onlineServers=0 2023-07-15 22:13:48,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41943,1689459061444' ***** 2023-07-15 22:13:48,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 22:13:48,542 DEBUG [M:0;jenkins-hbase4:41943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b58ed74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:13:48,542 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41943,1689459061444 2023-07-15 22:13:48,542 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41943,1689459061444; all regions closed. 2023-07-15 22:13:48,542 DEBUG [M:0;jenkins-hbase4:41943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:48,542 DEBUG [M:0;jenkins-hbase4:41943] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 22:13:48,543 DEBUG [M:0;jenkins-hbase4:41943] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 22:13:48,543 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 22:13:48,543 INFO [M:0;jenkins-hbase4:41943] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 22:13:48,543 INFO [M:0;jenkins-hbase4:41943] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 22:13:48,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459064764] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459064764,5,FailOnTimeoutGroup] 2023-07-15 22:13:48,543 INFO [M:0;jenkins-hbase4:41943] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 22:13:48,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459064766] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459064766,5,FailOnTimeoutGroup] 2023-07-15 22:13:48,543 DEBUG [M:0;jenkins-hbase4:41943] master.HMaster(1512): Stopping service threads 2023-07-15 22:13:48,543 INFO [M:0;jenkins-hbase4:41943] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 22:13:48,544 ERROR [M:0;jenkins-hbase4:41943] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 22:13:48,547 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 22:13:48,547 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:13:48,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:13:48,548 INFO [M:0;jenkins-hbase4:41943] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 22:13:48,548 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 22:13:48,548 DEBUG [M:0;jenkins-hbase4:41943] zookeeper.ZKUtil(398): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 22:13:48,549 WARN [M:0;jenkins-hbase4:41943] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 22:13:48,549 INFO [M:0;jenkins-hbase4:41943] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 22:13:48,549 INFO [M:0;jenkins-hbase4:41943] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 22:13:48,550 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 22:13:48,550 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:48,550 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:48,550 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 22:13:48,550 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:48,550 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.87 KB heapSize=452.09 KB 2023-07-15 22:13:48,562 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,562 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x1016b09f22c0002, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,562 INFO [RS:1;jenkins-hbase4:33297] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33297,1689459063148; zookeeper connection closed. 2023-07-15 22:13:48,567 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65233331] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65233331 2023-07-15 22:13:48,599 INFO [M:0;jenkins-hbase4:41943] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.87 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b68471a5b2854fef84e5765522723424 2023-07-15 22:13:48,603 INFO [M:0;jenkins-hbase4:41943] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b68471a5b2854fef84e5765522723424 2023-07-15 22:13:48,604 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b68471a5b2854fef84e5765522723424 as hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b68471a5b2854fef84e5765522723424 2023-07-15 22:13:48,610 INFO [M:0;jenkins-hbase4:41943] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b68471a5b2854fef84e5765522723424 2023-07-15 22:13:48,610 INFO [M:0;jenkins-hbase4:41943] regionserver.HStore(1080): Added hdfs://localhost:38251/user/jenkins/test-data/edfabd61-3642-8559-5433-d49e51417008/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b68471a5b2854fef84e5765522723424, entries=119, sequenceid=899, filesize=28.7 K 2023-07-15 22:13:48,611 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegion(2948): Finished flush of dataSize ~375.87 KB/384894, heapSize ~452.08 KB/462928, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 61ms, sequenceid=899, compaction requested=false 2023-07-15 22:13:48,613 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:48,613 DEBUG [M:0;jenkins-hbase4:41943] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:13:48,620 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:48,620 INFO [M:0;jenkins-hbase4:41943] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 22:13:48,621 INFO [M:0;jenkins-hbase4:41943] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41943 2023-07-15 22:13:48,622 DEBUG [M:0;jenkins-hbase4:41943] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41943,1689459061444 already deleted, retry=false 2023-07-15 22:13:48,662 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,662 INFO [RS:2;jenkins-hbase4:45299] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45299,1689459063195; zookeeper connection closed. 2023-07-15 22:13:48,662 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): regionserver:45299-0x1016b09f22c0003, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,662 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@622a2cbd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@622a2cbd 2023-07-15 22:13:48,663 INFO [Listener at jenkins-hbase4.apache.org/34497] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 22:13:48,762 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,762 INFO [M:0;jenkins-hbase4:41943] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41943,1689459061444; zookeeper connection closed. 2023-07-15 22:13:48,762 DEBUG [Listener at localhost/36625-EventThread] zookeeper.ZKWatcher(600): master:41943-0x1016b09f22c0000, quorum=127.0.0.1:53851, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:48,764 WARN [Listener at jenkins-hbase4.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:48,768 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:48,872 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:48,872 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1782949342-172.31.14.131-1689459057484 (Datanode Uuid f638764a-42e8-4d06-9c08-6dd883a91693) service to localhost/127.0.0.1:38251 2023-07-15 22:13:48,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data5/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:48,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data6/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:48,876 WARN [Listener at jenkins-hbase4.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:48,879 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:48,982 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:48,982 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1782949342-172.31.14.131-1689459057484 (Datanode Uuid cd480aee-e016-41f6-906f-3127f28d28ba) service to localhost/127.0.0.1:38251 2023-07-15 22:13:48,983 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data3/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:48,984 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data4/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:48,984 WARN [Listener at jenkins-hbase4.apache.org/34497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:48,987 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:49,090 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:49,091 WARN [BP-1782949342-172.31.14.131-1689459057484 heartbeating to localhost/127.0.0.1:38251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1782949342-172.31.14.131-1689459057484 (Datanode Uuid 036dad71-9a3f-4dbe-9eb6-b57b1fa85120) service to localhost/127.0.0.1:38251 2023-07-15 22:13:49,091 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data1/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:49,091 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e11bb24-1e3d-cc2c-419b-103f454ee712/cluster_a0c96262-aa93-8987-712e-453fcba4d5b2/dfs/data/data2/current/BP-1782949342-172.31.14.131-1689459057484] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:49,116 INFO [Listener at jenkins-hbase4.apache.org/34497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:49,248 INFO [Listener at jenkins-hbase4.apache.org/34497] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 22:13:49,341 INFO [Listener at jenkins-hbase4.apache.org/34497] hbase.HBaseTestingUtility(1293): Minicluster is down