2023-10-05 22:59:53,412 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 22:59:53,611 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f 2023-10-05 22:59:53,611 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 22:59:53,611 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 22:59:53,646 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 22:59:53,873 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 22:59:53,873 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8, deleteOnExit=true 2023-10-05 22:59:53,873 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 22:59:53,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/test.cache.data in system properties and HBase conf 2023-10-05 22:59:53,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 22:59:53,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop.log.dir in system properties and HBase conf 2023-10-05 22:59:53,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 22:59:53,876 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 22:59:53,876 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 22:59:54,210 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 22:59:54,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 22:59:54,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 22:59:54,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 22:59:54,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 22:59:54,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 22:59:54,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 22:59:54,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 22:59:54,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 22:59:54,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 22:59:54,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/nfs.dump.dir in system properties and HBase conf 2023-10-05 22:59:54,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir in system properties and HBase conf 2023-10-05 22:59:54,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 22:59:54,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 22:59:54,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 22:59:54,776 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 22:59:54,782 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 22:59:55,088 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 22:59:55,256 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 22:59:55,269 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 22:59:55,307 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 22:59:55,347 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_localhost_40291_hdfs____.2zr154/webapp 2023-10-05 22:59:55,509 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40291 2023-10-05 22:59:55,550 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 22:59:55,550 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 22:59:56,010 WARN [Listener at localhost/44933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 22:59:56,098 WARN [Listener at localhost/44933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 22:59:56,120 WARN [Listener at localhost/44933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 22:59:56,127 INFO [Listener at localhost/44933] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 22:59:56,133 INFO [Listener at localhost/44933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_localhost_39351_datanode____dxse34/webapp 2023-10-05 22:59:56,233 INFO [Listener at localhost/44933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39351 2023-10-05 22:59:56,712 WARN [Listener at localhost/39551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 22:59:56,725 WARN [Listener at localhost/39551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 22:59:56,729 WARN [Listener at localhost/39551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 22:59:56,731 INFO [Listener at localhost/39551] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 22:59:56,746 INFO [Listener at localhost/39551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_localhost_38311_datanode____.f7dn2j/webapp 2023-10-05 22:59:56,876 INFO [Listener at localhost/39551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38311 2023-10-05 22:59:56,889 WARN [Listener at localhost/38645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 22:59:56,910 WARN [Listener at localhost/38645] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 22:59:56,915 WARN [Listener at localhost/38645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 22:59:56,917 INFO [Listener at localhost/38645] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 22:59:56,927 INFO [Listener at localhost/38645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_localhost_39923_datanode____.y6l151/webapp 2023-10-05 22:59:57,073 INFO [Listener at localhost/38645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39923 2023-10-05 22:59:57,101 WARN [Listener at localhost/44633] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 22:59:57,322 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ca8f278c7b5c6d1: Processing first storage report for DS-60086a37-1ce8-4d96-a5db-51961440384b from datanode ab406a2c-c95e-4d3d-86f8-8dfaeff7ab0d 2023-10-05 22:59:57,324 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ca8f278c7b5c6d1: from storage DS-60086a37-1ce8-4d96-a5db-51961440384b node DatanodeRegistration(127.0.0.1:35617, datanodeUuid=ab406a2c-c95e-4d3d-86f8-8dfaeff7ab0d, infoPort=33695, infoSecurePort=0, ipcPort=39551, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,324 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b1529e36a200133: Processing first storage report for DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636 from datanode 447cd7e0-614b-4df4-9eaa-662b104f6c8f 2023-10-05 22:59:57,324 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b1529e36a200133: from storage DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636 node DatanodeRegistration(127.0.0.1:41497, datanodeUuid=447cd7e0-614b-4df4-9eaa-662b104f6c8f, infoPort=33797, infoSecurePort=0, ipcPort=38645, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,324 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa717807992ec542: Processing first storage report for DS-1afab079-478c-4743-afc6-2fa0aa74f26a from datanode 7f69eba1-2397-464d-b2eb-bc38257c61d8 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa717807992ec542: from storage DS-1afab079-478c-4743-afc6-2fa0aa74f26a node DatanodeRegistration(127.0.0.1:42571, datanodeUuid=7f69eba1-2397-464d-b2eb-bc38257c61d8, infoPort=34521, infoSecurePort=0, ipcPort=44633, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ca8f278c7b5c6d1: Processing first storage report for DS-76c598e8-955f-4d6e-ac72-8d99e4eeb6a6 from datanode ab406a2c-c95e-4d3d-86f8-8dfaeff7ab0d 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ca8f278c7b5c6d1: from storage DS-76c598e8-955f-4d6e-ac72-8d99e4eeb6a6 node DatanodeRegistration(127.0.0.1:35617, datanodeUuid=ab406a2c-c95e-4d3d-86f8-8dfaeff7ab0d, infoPort=33695, infoSecurePort=0, ipcPort=39551, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b1529e36a200133: Processing first storage report for DS-1c8396d2-88db-4ab4-99eb-d66c72047be4 from datanode 447cd7e0-614b-4df4-9eaa-662b104f6c8f 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b1529e36a200133: from storage DS-1c8396d2-88db-4ab4-99eb-d66c72047be4 node DatanodeRegistration(127.0.0.1:41497, datanodeUuid=447cd7e0-614b-4df4-9eaa-662b104f6c8f, infoPort=33797, infoSecurePort=0, ipcPort=38645, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfa717807992ec542: Processing first storage report for DS-e699526c-e3ba-457b-81f2-6478e48b05e6 from datanode 7f69eba1-2397-464d-b2eb-bc38257c61d8 2023-10-05 22:59:57,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfa717807992ec542: from storage DS-e699526c-e3ba-457b-81f2-6478e48b05e6 node DatanodeRegistration(127.0.0.1:42571, datanodeUuid=7f69eba1-2397-464d-b2eb-bc38257c61d8, infoPort=34521, infoSecurePort=0, ipcPort=44633, storageInfo=lv=-57;cid=testClusterID;nsid=2018133131;c=1696546794865), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 22:59:57,616 DEBUG [Listener at localhost/44633] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f 2023-10-05 22:59:57,706 INFO [Listener at localhost/44633] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/zookeeper_0, clientPort=64387, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 22:59:57,731 INFO [Listener at localhost/44633] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64387 2023-10-05 22:59:57,743 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:57,746 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:58,429 INFO [Listener at localhost/44633] util.FSUtils(471): Created version file at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd with version=8 2023-10-05 22:59:58,429 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/hbase-staging 2023-10-05 22:59:58,769 INFO [Listener at localhost/44633] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 22:59:59,251 INFO [Listener at localhost/44633] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 22:59:59,284 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,284 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,285 INFO [Listener at localhost/44633] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 22:59:59,285 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,285 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 22:59:59,434 INFO [Listener at localhost/44633] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 22:59:59,505 DEBUG [Listener at localhost/44633] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 22:59:59,596 INFO [Listener at localhost/44633] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41663 2023-10-05 22:59:59,609 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,611 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,633 INFO [Listener at localhost/44633] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41663 connecting to ZooKeeper ensemble=127.0.0.1:64387 2023-10-05 22:59:59,698 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:416630x0, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 22:59:59,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41663-0x10118d0f0190000 connected 2023-10-05 22:59:59,731 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 22:59:59,732 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 22:59:59,751 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 22:59:59,762 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41663 2023-10-05 22:59:59,763 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41663 2023-10-05 22:59:59,764 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41663 2023-10-05 22:59:59,764 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41663 2023-10-05 22:59:59,764 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41663 2023-10-05 22:59:59,771 INFO [Listener at localhost/44633] master.HMaster(444): hbase.rootdir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, hbase.cluster.distributed=false 2023-10-05 22:59:59,839 INFO [Listener at localhost/44633] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 22:59:59,839 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,839 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,840 INFO [Listener at localhost/44633] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 22:59:59,840 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,840 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 22:59:59,845 INFO [Listener at localhost/44633] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 22:59:59,848 INFO [Listener at localhost/44633] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37651 2023-10-05 22:59:59,851 INFO [Listener at localhost/44633] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 22:59:59,858 INFO [Listener at localhost/44633] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 22:59:59,859 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,862 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,864 INFO [Listener at localhost/44633] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37651 connecting to ZooKeeper ensemble=127.0.0.1:64387 2023-10-05 22:59:59,868 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:376510x0, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 22:59:59,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37651-0x10118d0f0190001 connected 2023-10-05 22:59:59,870 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 22:59:59,871 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 22:59:59,872 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 22:59:59,872 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37651 2023-10-05 22:59:59,873 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37651 2023-10-05 22:59:59,874 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37651 2023-10-05 22:59:59,874 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37651 2023-10-05 22:59:59,874 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37651 2023-10-05 22:59:59,887 INFO [Listener at localhost/44633] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 22:59:59,887 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,888 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,888 INFO [Listener at localhost/44633] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 22:59:59,888 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,889 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 22:59:59,889 INFO [Listener at localhost/44633] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 22:59:59,890 INFO [Listener at localhost/44633] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46597 2023-10-05 22:59:59,891 INFO [Listener at localhost/44633] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 22:59:59,892 INFO [Listener at localhost/44633] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 22:59:59,893 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,897 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,900 INFO [Listener at localhost/44633] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46597 connecting to ZooKeeper ensemble=127.0.0.1:64387 2023-10-05 22:59:59,904 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:465970x0, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 22:59:59,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46597-0x10118d0f0190002 connected 2023-10-05 22:59:59,905 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 22:59:59,905 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 22:59:59,906 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 22:59:59,908 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46597 2023-10-05 22:59:59,908 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46597 2023-10-05 22:59:59,908 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46597 2023-10-05 22:59:59,913 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46597 2023-10-05 22:59:59,913 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46597 2023-10-05 22:59:59,926 INFO [Listener at localhost/44633] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 22:59:59,926 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,926 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,926 INFO [Listener at localhost/44633] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 22:59:59,926 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 22:59:59,927 INFO [Listener at localhost/44633] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 22:59:59,927 INFO [Listener at localhost/44633] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 22:59:59,928 INFO [Listener at localhost/44633] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43513 2023-10-05 22:59:59,929 INFO [Listener at localhost/44633] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 22:59:59,930 INFO [Listener at localhost/44633] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 22:59:59,931 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,932 INFO [Listener at localhost/44633] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 22:59:59,933 INFO [Listener at localhost/44633] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43513 connecting to ZooKeeper ensemble=127.0.0.1:64387 2023-10-05 22:59:59,937 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:435130x0, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 22:59:59,938 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:435130x0, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 22:59:59,938 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:435130x0, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 22:59:59,939 DEBUG [Listener at localhost/44633] zookeeper.ZKUtil(164): regionserver:435130x0, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 22:59:59,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43513-0x10118d0f0190003 connected 2023-10-05 22:59:59,941 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43513 2023-10-05 22:59:59,941 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43513 2023-10-05 22:59:59,945 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43513 2023-10-05 22:59:59,945 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43513 2023-10-05 22:59:59,945 DEBUG [Listener at localhost/44633] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43513 2023-10-05 22:59:59,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 22:59:59,959 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 22:59:59,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 22:59:59,979 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 22:59:59,979 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 22:59:59,979 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 22:59:59,979 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 22:59:59,979 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 22:59:59,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 22:59:59,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41663,1696546798610 from backup master directory 2023-10-05 22:59:59,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 22:59:59,987 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 22:59:59,987 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 22:59:59,988 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 22:59:59,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 22:59:59,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 22:59:59,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 23:00:00,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/hbase.id with ID: 02784bb5-965d-46ed-a4b6-aaf98552a375 2023-10-05 23:00:00,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 23:00:00,158 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:00,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f0bceda to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:00,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76258838, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:00,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 23:00:00,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 23:00:00,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 23:00:00,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 23:00:00,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 23:00:00,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 23:00:00,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 23:00:00,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store-tmp 2023-10-05 23:00:00,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:00,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 23:00:00,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:00:00,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:00:00,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 23:00:00,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:00:00,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:00:00,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 23:00:00,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/WALs/jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:00:00,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41663%2C1696546798610, suffix=, logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/WALs/jenkins-hbase4.apache.org,41663,1696546798610, archiveDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/oldWALs, maxLogs=10 2023-10-05 23:00:00,460 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK] 2023-10-05 23:00:00,460 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK] 2023-10-05 23:00:00,460 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK] 2023-10-05 23:00:00,470 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 23:00:00,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/WALs/jenkins-hbase4.apache.org,41663,1696546798610/jenkins-hbase4.apache.org%2C41663%2C1696546798610.1696546800415 2023-10-05 23:00:00,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK], DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK], DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK]] 2023-10-05 23:00:00,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 23:00:00,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:00,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,610 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,618 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 23:00:00,652 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 23:00:00,665 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:00,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 23:00:00,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:00,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63057323, jitterRate=-0.06037266552448273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:00,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 23:00:00,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 23:00:00,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 23:00:00,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 23:00:00,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 23:00:00,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 23:00:00,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-05 23:00:00,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 23:00:00,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 23:00:00,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 23:00:00,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 23:00:00,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 23:00:00,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 23:00:00,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 23:00:00,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 23:00:00,831 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:00,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 23:00:00,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 23:00:00,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 23:00:00,851 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 23:00:00,851 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 23:00:00,851 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 23:00:00,851 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 23:00:00,852 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:00,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41663,1696546798610, sessionid=0x10118d0f0190000, setting cluster-up flag (Was=false) 2023-10-05 23:00:00,869 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:00,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 23:00:00,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:00:00,883 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:00,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 23:00:00,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:00:00,893 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp 2023-10-05 23:00:00,950 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(951): ClusterId : 02784bb5-965d-46ed-a4b6-aaf98552a375 2023-10-05 23:00:00,950 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(951): ClusterId : 02784bb5-965d-46ed-a4b6-aaf98552a375 2023-10-05 23:00:00,951 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(951): ClusterId : 02784bb5-965d-46ed-a4b6-aaf98552a375 2023-10-05 23:00:00,956 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 23:00:00,956 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 23:00:00,956 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 23:00:00,964 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 23:00:00,964 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 23:00:00,964 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 23:00:00,964 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 23:00:00,965 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 23:00:00,965 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 23:00:00,970 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 23:00:00,970 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 23:00:00,970 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 23:00:00,973 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ReadOnlyZKClient(139): Connect 0x0a6ef4b7 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:00,974 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ReadOnlyZKClient(139): Connect 0x54aba08c to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:00,974 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ReadOnlyZKClient(139): Connect 0x2fa714db to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:00,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 23:00:00,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:00,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 23:00:00,985 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a91b8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:00,987 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@969fc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 23:00:00,989 DEBUG [RS:2;jenkins-hbase4:43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a6c4469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:00,989 DEBUG [RS:2;jenkins-hbase4:43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e53cbfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 23:00:00,993 DEBUG [RS:0;jenkins-hbase4:37651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2160ff5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:00,993 DEBUG [RS:0;jenkins-hbase4:37651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@605df564, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 23:00:01,020 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43513 2023-10-05 23:00:01,020 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37651 2023-10-05 23:00:01,022 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46597 2023-10-05 23:00:01,025 INFO [RS:1;jenkins-hbase4:46597] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 23:00:01,025 INFO [RS:2;jenkins-hbase4:43513] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 23:00:01,026 INFO [RS:2;jenkins-hbase4:43513] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 23:00:01,025 INFO [RS:0;jenkins-hbase4:37651] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 23:00:01,026 INFO [RS:1;jenkins-hbase4:46597] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 23:00:01,026 INFO [RS:0;jenkins-hbase4:37651] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 23:00:01,027 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 23:00:01,027 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 23:00:01,027 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 23:00:01,028 INFO [RS:0;jenkins-hbase4:37651] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:01,028 INFO [RS:2;jenkins-hbase4:43513] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:01,028 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 23:00:01,028 INFO [RS:1;jenkins-hbase4:46597] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:01,028 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 23:00:01,028 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 23:00:01,032 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:37651, startcode=1696546799838 2023-10-05 23:00:01,032 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:43513, startcode=1696546799925 2023-10-05 23:00:01,033 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:46597, startcode=1696546799886 2023-10-05 23:00:01,054 DEBUG [RS:0;jenkins-hbase4:37651] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 23:00:01,054 DEBUG [RS:1;jenkins-hbase4:46597] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 23:00:01,054 DEBUG [RS:2;jenkins-hbase4:43513] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 23:00:01,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 23:00:01,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 23:00:01,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696546831123 2023-10-05 23:00:01,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 23:00:01,131 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 23:00:01,132 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 23:00:01,136 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55161, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 23:00:01,136 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46023, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 23:00:01,136 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38397, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 23:00:01,139 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 23:00:01,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 23:00:01,147 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 23:00:01,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 23:00:01,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 23:00:01,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 23:00:01,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 23:00:01,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 23:00:01,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 23:00:01,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 23:00:01,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 23:00:01,160 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 23:00:01,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 23:00:01,160 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 23:00:01,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696546801163,5,FailOnTimeoutGroup] 2023-10-05 23:00:01,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696546801163,5,FailOnTimeoutGroup] 2023-10-05 23:00:01,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 23:00:01,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,193 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:01,194 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:01,194 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:01,197 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 23:00:01,197 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 23:00:01,198 WARN [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 23:00:01,197 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 23:00:01,198 WARN [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 23:00:01,198 WARN [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 23:00:01,219 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:01,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 23:00:01,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/info 2023-10-05 23:00:01,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 23:00:01,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 23:00:01,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/rep_barrier 2023-10-05 23:00:01,229 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 23:00:01,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 23:00:01,232 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/table 2023-10-05 23:00:01,233 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 23:00:01,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,235 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740 2023-10-05 23:00:01,236 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740 2023-10-05 23:00:01,240 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 23:00:01,242 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 23:00:01,247 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:01,248 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64350268, jitterRate=-0.04110628366470337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 23:00:01,248 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 23:00:01,248 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 23:00:01,248 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 23:00:01,248 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 23:00:01,248 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 23:00:01,248 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 23:00:01,254 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 23:00:01,254 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 23:00:01,260 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 23:00:01,261 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 23:00:01,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 23:00:01,285 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 23:00:01,288 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 23:00:01,299 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:46597, startcode=1696546799886 2023-10-05 23:00:01,299 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:37651, startcode=1696546799838 2023-10-05 23:00:01,299 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41663,1696546798610 with isa=jenkins-hbase4.apache.org/172.31.14.131:43513, startcode=1696546799925 2023-10-05 23:00:01,305 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,310 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,311 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:01,311 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41663] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,311 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44933 2023-10-05 23:00:01,312 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 23:00:01,312 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:01,313 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44933 2023-10-05 23:00:01,313 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 23:00:01,313 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:01,313 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44933 2023-10-05 23:00:01,313 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 23:00:01,323 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:00:01,324 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ZKUtil(162): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,324 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,324 WARN [RS:2;jenkins-hbase4:43513] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 23:00:01,325 WARN [RS:1;jenkins-hbase4:46597] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 23:00:01,325 INFO [RS:2;jenkins-hbase4:43513] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 23:00:01,325 INFO [RS:1;jenkins-hbase4:46597] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 23:00:01,326 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,326 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ZKUtil(162): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,326 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,326 WARN [RS:0;jenkins-hbase4:37651] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 23:00:01,326 INFO [RS:0;jenkins-hbase4:37651] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 23:00:01,326 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,327 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37651,1696546799838] 2023-10-05 23:00:01,327 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43513,1696546799925] 2023-10-05 23:00:01,327 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46597,1696546799886] 2023-10-05 23:00:01,342 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,342 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ZKUtil(162): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,342 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ZKUtil(162): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,343 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,343 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ZKUtil(162): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,343 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ZKUtil(162): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,343 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,343 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ZKUtil(162): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,343 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ZKUtil(162): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,356 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 23:00:01,356 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 23:00:01,356 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 23:00:01,367 INFO [RS:2;jenkins-hbase4:43513] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 23:00:01,367 INFO [RS:1;jenkins-hbase4:46597] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 23:00:01,367 INFO [RS:0;jenkins-hbase4:37651] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 23:00:01,391 INFO [RS:2;jenkins-hbase4:43513] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 23:00:01,391 INFO [RS:0;jenkins-hbase4:37651] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 23:00:01,391 INFO [RS:1;jenkins-hbase4:46597] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 23:00:01,396 INFO [RS:2;jenkins-hbase4:43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 23:00:01,396 INFO [RS:0;jenkins-hbase4:37651] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 23:00:01,396 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,396 INFO [RS:1;jenkins-hbase4:46597] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 23:00:01,397 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,397 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,397 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 23:00:01,398 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 23:00:01,397 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 23:00:01,407 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,407 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,407 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,407 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,407 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,407 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,407 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,409 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,409 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,408 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,409 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,409 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,409 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 23:00:01,410 DEBUG [RS:2;jenkins-hbase4:43513] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,410 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,410 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,410 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,410 DEBUG [RS:0;jenkins-hbase4:37651] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 23:00:01,412 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,412 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,412 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,413 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,413 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,413 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,417 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,417 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,417 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,436 INFO [RS:2;jenkins-hbase4:43513] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 23:00:01,436 INFO [RS:1;jenkins-hbase4:46597] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 23:00:01,436 INFO [RS:0;jenkins-hbase4:37651] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 23:00:01,440 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43513,1696546799925-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,440 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37651,1696546799838-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,440 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46597,1696546799886-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:01,441 DEBUG [jenkins-hbase4:41663] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 23:00:01,445 DEBUG [jenkins-hbase4:41663] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:01,453 DEBUG [jenkins-hbase4:41663] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:01,453 DEBUG [jenkins-hbase4:41663] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:01,453 DEBUG [jenkins-hbase4:41663] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:01,453 DEBUG [jenkins-hbase4:41663] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:01,457 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43513,1696546799925, state=OPENING 2023-10-05 23:00:01,465 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 23:00:01,468 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:01,469 INFO [RS:0;jenkins-hbase4:37651] regionserver.Replication(203): jenkins-hbase4.apache.org,37651,1696546799838 started 2023-10-05 23:00:01,469 INFO [RS:2;jenkins-hbase4:43513] regionserver.Replication(203): jenkins-hbase4.apache.org,43513,1696546799925 started 2023-10-05 23:00:01,469 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37651,1696546799838, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37651, sessionid=0x10118d0f0190001 2023-10-05 23:00:01,469 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 23:00:01,469 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43513,1696546799925, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43513, sessionid=0x10118d0f0190003 2023-10-05 23:00:01,473 INFO [RS:1;jenkins-hbase4:46597] regionserver.Replication(203): jenkins-hbase4.apache.org,46597,1696546799886 started 2023-10-05 23:00:01,473 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 23:00:01,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:01,473 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 23:00:01,474 DEBUG [RS:0;jenkins-hbase4:37651] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,473 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46597,1696546799886, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46597, sessionid=0x10118d0f0190002 2023-10-05 23:00:01,474 DEBUG [RS:2;jenkins-hbase4:43513] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,474 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37651,1696546799838' 2023-10-05 23:00:01,475 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43513,1696546799925' 2023-10-05 23:00:01,475 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 23:00:01,475 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 23:00:01,475 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 23:00:01,475 DEBUG [RS:1;jenkins-hbase4:46597] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,476 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46597,1696546799886' 2023-10-05 23:00:01,476 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 23:00:01,478 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 23:00:01,478 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 23:00:01,478 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 23:00:01,479 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 23:00:01,479 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 23:00:01,479 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 23:00:01,479 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 23:00:01,479 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 23:00:01,479 DEBUG [RS:2;jenkins-hbase4:43513] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,479 DEBUG [RS:1;jenkins-hbase4:46597] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:01,479 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 23:00:01,480 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46597,1696546799886' 2023-10-05 23:00:01,480 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:01,480 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43513,1696546799925' 2023-10-05 23:00:01,480 DEBUG [RS:0;jenkins-hbase4:37651] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:01,480 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37651,1696546799838' 2023-10-05 23:00:01,481 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:01,481 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:01,481 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:01,481 DEBUG [RS:0;jenkins-hbase4:37651] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:01,481 DEBUG [RS:2;jenkins-hbase4:43513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:01,482 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 23:00:01,482 DEBUG [RS:0;jenkins-hbase4:37651] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 23:00:01,482 INFO [RS:1;jenkins-hbase4:46597] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 23:00:01,482 INFO [RS:1;jenkins-hbase4:46597] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 23:00:01,482 INFO [RS:0;jenkins-hbase4:37651] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 23:00:01,483 DEBUG [RS:2;jenkins-hbase4:43513] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 23:00:01,483 INFO [RS:0;jenkins-hbase4:37651] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 23:00:01,484 INFO [RS:2;jenkins-hbase4:43513] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 23:00:01,484 INFO [RS:2;jenkins-hbase4:43513] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 23:00:01,594 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46597%2C1696546799886, suffix=, logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,46597,1696546799886, archiveDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs, maxLogs=32 2023-10-05 23:00:01,594 INFO [RS:0;jenkins-hbase4:37651] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37651%2C1696546799838, suffix=, logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,37651,1696546799838, archiveDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs, maxLogs=32 2023-10-05 23:00:01,595 INFO [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43513%2C1696546799925, suffix=, logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925, archiveDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs, maxLogs=32 2023-10-05 23:00:01,627 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK] 2023-10-05 23:00:01,627 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK] 2023-10-05 23:00:01,627 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK] 2023-10-05 23:00:01,628 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK] 2023-10-05 23:00:01,628 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK] 2023-10-05 23:00:01,629 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK] 2023-10-05 23:00:01,638 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK] 2023-10-05 23:00:01,638 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK] 2023-10-05 23:00:01,638 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK] 2023-10-05 23:00:01,646 INFO [RS:0;jenkins-hbase4:37651] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,37651,1696546799838/jenkins-hbase4.apache.org%2C37651%2C1696546799838.1696546801600 2023-10-05 23:00:01,646 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,46597,1696546799886/jenkins-hbase4.apache.org%2C46597%2C1696546799886.1696546801600 2023-10-05 23:00:01,650 DEBUG [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK], DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK], DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK]] 2023-10-05 23:00:01,654 DEBUG [RS:0;jenkins-hbase4:37651] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK], DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK], DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK]] 2023-10-05 23:00:01,658 INFO [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925/jenkins-hbase4.apache.org%2C43513%2C1696546799925.1696546801599 2023-10-05 23:00:01,659 DEBUG [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK], DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK], DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK]] 2023-10-05 23:00:01,683 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:01,686 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:00:01,689 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:00:01,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 23:00:01,707 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 23:00:01,711 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43513%2C1696546799925.meta, suffix=.meta, logDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925, archiveDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs, maxLogs=32 2023-10-05 23:00:01,731 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK] 2023-10-05 23:00:01,732 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK] 2023-10-05 23:00:01,733 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK] 2023-10-05 23:00:01,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925/jenkins-hbase4.apache.org%2C43513%2C1696546799925.meta.1696546801712.meta 2023-10-05 23:00:01,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35617,DS-60086a37-1ce8-4d96-a5db-51961440384b,DISK], DatanodeInfoWithStorage[127.0.0.1:41497,DS-d6f3c01f-0a23-4647-82a6-fa7d8ecfd636,DISK], DatanodeInfoWithStorage[127.0.0.1:42571,DS-1afab079-478c-4743-afc6-2fa0aa74f26a,DISK]] 2023-10-05 23:00:01,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 23:00:01,745 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 23:00:01,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:01,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 23:00:01,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 23:00:01,751 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 23:00:01,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 23:00:01,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:01,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 23:00:01,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 23:00:01,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 23:00:01,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/info 2023-10-05 23:00:01,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/info 2023-10-05 23:00:01,775 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 23:00:01,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 23:00:01,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/rep_barrier 2023-10-05 23:00:01,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/rep_barrier 2023-10-05 23:00:01,778 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 23:00:01,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 23:00:01,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/table 2023-10-05 23:00:01,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/table 2023-10-05 23:00:01,784 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 23:00:01,785 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:01,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740 2023-10-05 23:00:01,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740 2023-10-05 23:00:01,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 23:00:01,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 23:00:01,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62075235, jitterRate=-0.07500691711902618}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 23:00:01,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 23:00:01,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696546801671 2023-10-05 23:00:01,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 23:00:01,837 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 23:00:01,838 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43513,1696546799925, state=OPEN 2023-10-05 23:00:01,841 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 23:00:01,842 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 23:00:01,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 23:00:01,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43513,1696546799925 in 369 msec 2023-10-05 23:00:01,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 23:00:01,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 579 msec 2023-10-05 23:00:01,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 867 msec 2023-10-05 23:00:01,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696546801859, completionTime=-1 2023-10-05 23:00:01,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 23:00:01,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 23:00:01,973 DEBUG [hconnection-0x22b6e940-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:01,977 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:02,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 23:00:02,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696546862010 2023-10-05 23:00:02,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696546922010 2023-10-05 23:00:02,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 150 msec 2023-10-05 23:00:02,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41663,1696546798610-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:02,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41663,1696546798610-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:02,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41663,1696546798610-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:02,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41663, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:02,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 23:00:02,046 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 23:00:02,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 23:00:02,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 23:00:02,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 23:00:02,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:00:02,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:00:02,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,098 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9 empty. 2023-10-05 23:00:02,098 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,099 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 23:00:02,144 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:02,147 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d6b4667647a5d88298b34a89f1bcd9a9, NAME => 'hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d6b4667647a5d88298b34a89f1bcd9a9, disabling compactions & flushes 2023-10-05 23:00:02,168 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. after waiting 0 ms 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,168 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,168 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d6b4667647a5d88298b34a89f1bcd9a9: 2023-10-05 23:00:02,173 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:00:02,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696546802176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546802176"}]},"ts":"1696546802176"} 2023-10-05 23:00:02,218 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 23:00:02,220 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:00:02,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546802220"}]},"ts":"1696546802220"} 2023-10-05 23:00:02,228 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 23:00:02,235 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:02,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:02,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:02,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:02,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:02,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6b4667647a5d88298b34a89f1bcd9a9, ASSIGN}] 2023-10-05 23:00:02,242 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6b4667647a5d88298b34a89f1bcd9a9, ASSIGN 2023-10-05 23:00:02,244 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d6b4667647a5d88298b34a89f1bcd9a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:00:02,396 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 23:00:02,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6b4667647a5d88298b34a89f1bcd9a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:02,398 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696546802397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546802397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546802397"}]},"ts":"1696546802397"} 2023-10-05 23:00:02,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d6b4667647a5d88298b34a89f1bcd9a9, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:02,568 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6b4667647a5d88298b34a89f1bcd9a9, NAME => 'hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.', STARTKEY => '', ENDKEY => ''} 2023-10-05 23:00:02,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. service=AccessControlService 2023-10-05 23:00:02,570 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:02,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:02,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,573 INFO [StoreOpener-d6b4667647a5d88298b34a89f1bcd9a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,576 DEBUG [StoreOpener-d6b4667647a5d88298b34a89f1bcd9a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/info 2023-10-05 23:00:02,576 DEBUG [StoreOpener-d6b4667647a5d88298b34a89f1bcd9a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/info 2023-10-05 23:00:02,576 INFO [StoreOpener-d6b4667647a5d88298b34a89f1bcd9a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6b4667647a5d88298b34a89f1bcd9a9 columnFamilyName info 2023-10-05 23:00:02,577 INFO [StoreOpener-d6b4667647a5d88298b34a89f1bcd9a9-1] regionserver.HStore(310): Store=d6b4667647a5d88298b34a89f1bcd9a9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:02,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:00:02,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:02,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6b4667647a5d88298b34a89f1bcd9a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74862905, jitterRate=0.11554421484470367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:02,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6b4667647a5d88298b34a89f1bcd9a9: 2023-10-05 23:00:02,594 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9., pid=6, masterSystemTime=1696546802561 2023-10-05 23:00:02,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:00:02,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6b4667647a5d88298b34a89f1bcd9a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:02,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696546802598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546802598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546802598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546802598"}]},"ts":"1696546802598"} 2023-10-05 23:00:02,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 23:00:02,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d6b4667647a5d88298b34a89f1bcd9a9, server=jenkins-hbase4.apache.org,43513,1696546799925 in 198 msec 2023-10-05 23:00:02,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 23:00:02,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d6b4667647a5d88298b34a89f1bcd9a9, ASSIGN in 368 msec 2023-10-05 23:00:02,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:00:02,614 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546802614"}]},"ts":"1696546802614"} 2023-10-05 23:00:02,616 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 23:00:02,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:00:02,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 563 msec 2023-10-05 23:00:02,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 23:00:02,670 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 23:00:02,670 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:02,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 23:00:02,727 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 23:00:02,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-10-05 23:00:02,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 23:00:02,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 23:00:02,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-05 23:00:02,769 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 23:00:02,772 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 23:00:02,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.784sec 2023-10-05 23:00:02,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 23:00:02,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 23:00:02,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 23:00:02,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41663,1696546798610-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 23:00:02,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41663,1696546798610-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 23:00:02,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 23:00:02,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 23:00:02,803 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:00:02,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:00:02,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 23:00:02,808 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:02,809 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede empty. 2023-10-05 23:00:02,811 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:02,811 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 23:00:02,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 23:00:02,837 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:02,839 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf1ba7f11401a438c3aac77c40b81ede, NAME => 'hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing bf1ba7f11401a438c3aac77c40b81ede, disabling compactions & flushes 2023-10-05 23:00:02,860 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. after waiting 0 ms 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:02,860 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:02,860 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for bf1ba7f11401a438c3aac77c40b81ede: 2023-10-05 23:00:02,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:00:02,866 DEBUG [Listener at localhost/44633] zookeeper.ReadOnlyZKClient(139): Connect 0x35229d65 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:02,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696546802867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546802867"}]},"ts":"1696546802867"} 2023-10-05 23:00:02,871 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 23:00:02,872 DEBUG [Listener at localhost/44633] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d2f3867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:02,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:00:02,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546802873"}]},"ts":"1696546802873"} 2023-10-05 23:00:02,877 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 23:00:02,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:02,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:02,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:02,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:02,884 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:02,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bf1ba7f11401a438c3aac77c40b81ede, ASSIGN}] 2023-10-05 23:00:02,887 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bf1ba7f11401a438c3aac77c40b81ede, ASSIGN 2023-10-05 23:00:02,889 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=bf1ba7f11401a438c3aac77c40b81ede, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:00:02,890 DEBUG [hconnection-0x5f092bc3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:02,902 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:02,905 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:00:02,905 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 23:00:02,905 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/test.cache.data in system properties and HBase conf 2023-10-05 23:00:02,905 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 23:00:02,905 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop.log.dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 23:00:02,906 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/nfs.dump.dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 23:00:02,907 INFO [Listener at localhost/44633] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 23:00:02,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 23:00:03,039 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 23:00:03,041 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bf1ba7f11401a438c3aac77c40b81ede, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:03,041 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696546803041"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546803041"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546803041"}]},"ts":"1696546803041"} 2023-10-05 23:00:03,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure bf1ba7f11401a438c3aac77c40b81ede, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:00:03,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 23:00:03,206 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:03,206 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:00:03,210 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:00:03,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:03,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf1ba7f11401a438c3aac77c40b81ede, NAME => 'hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.', STARTKEY => '', ENDKEY => ''} 2023-10-05 23:00:03,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. service=AccessControlService 2023-10-05 23:00:03,218 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:03,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:03,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,225 INFO [StoreOpener-bf1ba7f11401a438c3aac77c40b81ede-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,228 DEBUG [StoreOpener-bf1ba7f11401a438c3aac77c40b81ede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/l 2023-10-05 23:00:03,228 DEBUG [StoreOpener-bf1ba7f11401a438c3aac77c40b81ede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/l 2023-10-05 23:00:03,228 INFO [StoreOpener-bf1ba7f11401a438c3aac77c40b81ede-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf1ba7f11401a438c3aac77c40b81ede columnFamilyName l 2023-10-05 23:00:03,229 INFO [StoreOpener-bf1ba7f11401a438c3aac77c40b81ede-1] regionserver.HStore(310): Store=bf1ba7f11401a438c3aac77c40b81ede/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:03,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:00:03,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:03,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf1ba7f11401a438c3aac77c40b81ede; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71202051, jitterRate=0.06099323928356171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:03,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf1ba7f11401a438c3aac77c40b81ede: 2023-10-05 23:00:03,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede., pid=11, masterSystemTime=1696546803206 2023-10-05 23:00:03,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:03,251 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:00:03,253 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bf1ba7f11401a438c3aac77c40b81ede, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:03,253 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696546803252"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546803252"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546803252"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546803252"}]},"ts":"1696546803252"} 2023-10-05 23:00:03,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 23:00:03,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure bf1ba7f11401a438c3aac77c40b81ede, server=jenkins-hbase4.apache.org,37651,1696546799838 in 211 msec 2023-10-05 23:00:03,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 23:00:03,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=bf1ba7f11401a438c3aac77c40b81ede, ASSIGN in 376 msec 2023-10-05 23:00:03,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:00:03,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546803270"}]},"ts":"1696546803270"} 2023-10-05 23:00:03,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 23:00:03,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:00:03,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 478 msec 2023-10-05 23:00:03,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 23:00:03,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 23:00:03,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 23:00:04,132 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 23:00:04,501 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 23:00:04,508 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34125_jobhistory____.ahmmlg/webapp 2023-10-05 23:00:04,731 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 23:00:04,731 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 23:00:04,731 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 23:00:04,736 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 23:00:04,861 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:05,222 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:05,513 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 23:00:05,544 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34125 2023-10-05 23:00:05,626 WARN [Listener at jenkins-hbase4.apache.org/46765] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 23:00:05,974 WARN [Listener at jenkins-hbase4.apache.org/46765] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 23:00:05,975 INFO [Listener at jenkins-hbase4.apache.org/46765] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 23:00:05,982 INFO [Listener at jenkins-hbase4.apache.org/46765] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34887_cluster____.fqxemq/webapp 2023-10-05 23:00:06,055 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 23:00:06,055 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 23:00:06,055 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 23:00:06,056 INFO [Listener at jenkins-hbase4.apache.org/46765] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 23:00:06,065 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:06,272 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:06,362 INFO [Listener at jenkins-hbase4.apache.org/46765] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:06,376 INFO [Listener at jenkins-hbase4.apache.org/46765] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34887 2023-10-05 23:00:06,975 WARN [Listener at jenkins-hbase4.apache.org/33573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 23:00:07,001 WARN [Listener at jenkins-hbase4.apache.org/33573] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 23:00:07,002 INFO [Listener at jenkins-hbase4.apache.org/33573] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 23:00:07,010 INFO [Listener at jenkins-hbase4.apache.org/33573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46779_node____.dyqrzf/webapp 2023-10-05 23:00:07,063 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 23:00:07,063 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 23:00:07,063 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 23:00:07,063 INFO [Listener at jenkins-hbase4.apache.org/33573] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 23:00:07,072 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,096 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,182 INFO [Listener at jenkins-hbase4.apache.org/33573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,197 INFO [Listener at jenkins-hbase4.apache.org/33573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46779 2023-10-05 23:00:07,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:00:07,489 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 23:00:07,494 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 23:00:07,495 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 23:00:07,546 WARN [Listener at jenkins-hbase4.apache.org/41245] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 23:00:07,555 WARN [Listener at jenkins-hbase4.apache.org/41245] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 23:00:07,556 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 23:00:07,566 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33123_node____38mwpc/webapp 2023-10-05 23:00:07,624 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 23:00:07,624 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 23:00:07,624 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 23:00:07,624 INFO [Listener at jenkins-hbase4.apache.org/41245] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 23:00:07,632 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,649 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,726 INFO [Listener at jenkins-hbase4.apache.org/41245] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 23:00:07,744 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33123 2023-10-05 23:00:07,769 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 23:00:07,771 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:07,845 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=168, AvailableMemoryMB=6803 2023-10-05 23:00:07,845 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-10-05 23:00:07,860 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 23:00:07,865 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 23:00:07,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:00:07,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:07,876 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:00:07,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 23:00:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 23:00:07,879 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:00:07,887 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:07,887 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:07,888 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e empty. 2023-10-05 23:00:07,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba empty. 2023-10-05 23:00:07,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:07,898 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:07,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 23:00:07,928 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:07,930 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0556318cdaf7a36792ce7a5a56e692e, NAME => 'testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:07,930 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => fcd43b1097ce78ace1dc3fe5c3794eba, NAME => 'testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:07,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:07,972 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f0556318cdaf7a36792ce7a5a56e692e, disabling compactions & flushes 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing fcd43b1097ce78ace1dc3fe5c3794eba, disabling compactions & flushes 2023-10-05 23:00:07,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:07,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. after waiting 0 ms 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. after waiting 0 ms 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:07,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:07,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f0556318cdaf7a36792ce7a5a56e692e: 2023-10-05 23:00:07,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for fcd43b1097ce78ace1dc3fe5c3794eba: 2023-10-05 23:00:07,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 23:00:07,982 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:00:07,984 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546807983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546807983"}]},"ts":"1696546807983"} 2023-10-05 23:00:07,984 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546807983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546807983"}]},"ts":"1696546807983"} 2023-10-05 23:00:08,032 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:00:08,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:00:08,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546808034"}]},"ts":"1696546808034"} 2023-10-05 23:00:08,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 23:00:08,041 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:08,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, ASSIGN}] 2023-10-05 23:00:08,047 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, ASSIGN 2023-10-05 23:00:08,047 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, ASSIGN 2023-10-05 23:00:08,048 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:00:08,048 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46597,1696546799886; forceNewPlan=false, retain=false 2023-10-05 23:00:08,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 23:00:08,198 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:00:08,201 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f0556318cdaf7a36792ce7a5a56e692e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:08,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fcd43b1097ce78ace1dc3fe5c3794eba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:08,201 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546808201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546808201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546808201"}]},"ts":"1696546808201"} 2023-10-05 23:00:08,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546808201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546808201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546808201"}]},"ts":"1696546808201"} 2023-10-05 23:00:08,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f0556318cdaf7a36792ce7a5a56e692e, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:08,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure fcd43b1097ce78ace1dc3fe5c3794eba, server=jenkins-hbase4.apache.org,46597,1696546799886}] 2023-10-05 23:00:08,361 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:08,361 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:00:08,368 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:00:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0556318cdaf7a36792ce7a5a56e692e, NAME => 'testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:00:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. service=AccessControlService 2023-10-05 23:00:08,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:08,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:08,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:08,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcd43b1097ce78ace1dc3fe5c3794eba, NAME => 'testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:00:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. service=AccessControlService 2023-10-05 23:00:08,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,382 INFO [StoreOpener-f0556318cdaf7a36792ce7a5a56e692e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,383 INFO [StoreOpener-fcd43b1097ce78ace1dc3fe5c3794eba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,384 DEBUG [StoreOpener-f0556318cdaf7a36792ce7a5a56e692e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf 2023-10-05 23:00:08,385 DEBUG [StoreOpener-f0556318cdaf7a36792ce7a5a56e692e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf 2023-10-05 23:00:08,386 DEBUG [StoreOpener-fcd43b1097ce78ace1dc3fe5c3794eba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf 2023-10-05 23:00:08,386 DEBUG [StoreOpener-fcd43b1097ce78ace1dc3fe5c3794eba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf 2023-10-05 23:00:08,388 INFO [StoreOpener-f0556318cdaf7a36792ce7a5a56e692e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0556318cdaf7a36792ce7a5a56e692e columnFamilyName cf 2023-10-05 23:00:08,388 INFO [StoreOpener-fcd43b1097ce78ace1dc3fe5c3794eba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcd43b1097ce78ace1dc3fe5c3794eba columnFamilyName cf 2023-10-05 23:00:08,391 INFO [StoreOpener-f0556318cdaf7a36792ce7a5a56e692e-1] regionserver.HStore(310): Store=f0556318cdaf7a36792ce7a5a56e692e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:08,391 INFO [StoreOpener-fcd43b1097ce78ace1dc3fe5c3794eba-1] regionserver.HStore(310): Store=fcd43b1097ce78ace1dc3fe5c3794eba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:08,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:08,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:08,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:08,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0556318cdaf7a36792ce7a5a56e692e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70900789, jitterRate=0.056504085659980774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:08,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0556318cdaf7a36792ce7a5a56e692e: 2023-10-05 23:00:08,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e., pid=15, masterSystemTime=1696546808357 2023-10-05 23:00:08,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:08,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:08,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:08,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f0556318cdaf7a36792ce7a5a56e692e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:08,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546808419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546808419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546808419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546808419"}]},"ts":"1696546808419"} 2023-10-05 23:00:08,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fcd43b1097ce78ace1dc3fe5c3794eba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59126585, jitterRate=-0.11894522607326508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:08,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fcd43b1097ce78ace1dc3fe5c3794eba: 2023-10-05 23:00:08,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba., pid=16, masterSystemTime=1696546808361 2023-10-05 23:00:08,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:08,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:08,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-05 23:00:08,431 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fcd43b1097ce78ace1dc3fe5c3794eba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:08,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f0556318cdaf7a36792ce7a5a56e692e, server=jenkins-hbase4.apache.org,43513,1696546799925 in 221 msec 2023-10-05 23:00:08,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546808431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546808431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546808431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546808431"}]},"ts":"1696546808431"} 2023-10-05 23:00:08,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, ASSIGN in 387 msec 2023-10-05 23:00:08,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-05 23:00:08,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure fcd43b1097ce78ace1dc3fe5c3794eba, server=jenkins-hbase4.apache.org,46597,1696546799886 in 230 msec 2023-10-05 23:00:08,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-05 23:00:08,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, ASSIGN in 400 msec 2023-10-05 23:00:08,449 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:00:08,450 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546808449"}]},"ts":"1696546808449"} 2023-10-05 23:00:08,452 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 23:00:08,455 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:00:08,460 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 23:00:08,465 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:08,468 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:08,472 DEBUG [hconnection-0x66af0e39-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:08,474 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-10-05 23:00:08,483 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 23:00:08,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 23:00:08,514 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:08,514 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:08,514 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:00:08,514 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:08,514 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:08,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:08,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:08,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:08,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:08,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 654 msec 2023-10-05 23:00:08,765 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:08,766 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 23:00:08,766 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:08,766 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 23:00:08,767 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 23:00:08,767 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 23:00:08,767 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:08,767 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 23:00:08,767 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 23:00:08,767 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 23:00:08,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 23:00:08,986 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 23:00:08,990 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 23:00:08,991 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:08,994 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:09,020 DEBUG [hconnection-0x5f092bc3-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:09,026 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:09,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:09,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546809040 (current time:1696546809040). 2023-10-05 23:00:09,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:09,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x6877833b to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e99d77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:09,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:09,050 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:09,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6877833b to 127.0.0.1:64387 2023-10-05 23:00:09,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:09,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x4b09b861 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:09,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607f5610, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:09,064 DEBUG [hconnection-0x5c2a33cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:09,067 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:09,075 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b09b861 to 127.0.0.1:64387 2023-10-05 23:00:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 23:00:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:09,115 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:09,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:09,136 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:09,137 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696547409137 2023-10-05 23:00:09,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:09,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 23:00:09,140 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:09,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:09,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-05 23:00:09,143 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:09,144 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696547409144 2023-10-05 23:00:09,145 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:09,145 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:09,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,168 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 23:00:09,168 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:09,168 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 23:00:09,168 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 23:00:09,169 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,169 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,176 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,176 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,176 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,176 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,177 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,177 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:09,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:09,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:09,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,187 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:09,187 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:09,187 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:09,187 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:09,193 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,193 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:09,194 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63026382[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:09,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 23:00:09,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63026382[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:09,200 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 23:00:09,201 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:09,204 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,203 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,204 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:09,204 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:09,204 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,204 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:09,205 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:09,205 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:09,205 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:09,205 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:09,205 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:09,205 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:09,206 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. started... 2023-10-05 23:00:09,206 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. started... 2023-10-05 23:00:09,209 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:09,209 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:09,209 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:09,211 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f0556318cdaf7a36792ce7a5a56e692e: 2023-10-05 23:00:09,211 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcd43b1097ce78ace1dc3fe5c3794eba: 2023-10-05 23:00:09,212 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,212 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,218 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:09,218 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:09,221 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:09,221 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:09,245 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:09,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:09,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:09,254 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:09,255 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. completed. 2023-10-05 23:00:09,255 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:09,258 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:09,258 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:09,258 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,258 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:09,258 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:09,260 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:09,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:09,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46597,1696546799886': 2023-10-05 23:00:09,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 23:00:09,455 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:09,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:09,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:09,457 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 23:00:09,655 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. completed. 2023-10-05 23:00:09,655 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,656 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:09,656 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:09,658 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:09,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 23:00:09,664 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 23:00:09,664 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:09,664 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:09,664 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,664 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:09,668 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:09,669 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,669 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:09,671 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,672 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,672 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:09,685 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:09,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:09,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,686 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:09,685 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,687 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 23:00:09,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:09,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:09,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:09,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:00:09,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,757 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:09,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:09,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:09,759 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 23:00:09,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 23:00:09,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,767 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:09,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696546809137Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696546809707 (+570 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696546809707Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696546809708 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696546809720 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696546809753 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696546809766 (+13 ms) 2023-10-05 23:00:09,769 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:09,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 630 msec 2023-10-05 23:00:10,259 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:10,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:10,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:10,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:10,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46597] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:10,281 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 23:00:10,281 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:10,281 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:10,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:10,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546810295 (current time:1696546810295). 2023-10-05 23:00:10,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:10,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x36c54d68 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47bf25df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:10,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:10,308 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36c54d68 to 127.0.0.1:64387 2023-10-05 23:00:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:10,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x3c922bcf to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:10,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a09f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:10,317 DEBUG [hconnection-0x1e0fd72e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:10,321 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:10,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:10,327 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:10,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c922bcf to 127.0.0.1:64387 2023-10-05 23:00:10,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:10,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 23:00:10,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:10,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:10,333 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:10,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:10,335 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:10,336 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696547410336 2023-10-05 23:00:10,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 23:00:10,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 23:00:10,338 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:10,338 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:10,339 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 23:00:10,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:10,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-05 23:00:10,341 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:10,342 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696547410342 2023-10-05 23:00:10,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 23:00:10,358 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 23:00:10,358 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:10,359 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 23:00:10,359 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 23:00:10,359 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,360 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,361 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:10,361 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:10,361 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:10,361 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:10,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:10,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:10,362 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,362 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,362 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,362 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:10,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:10,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 23:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 23:00:10,364 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 23:00:10,364 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:10,364 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:10,366 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 23:00:10,369 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:10,370 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c89cc7[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 23:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c89cc7[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:10,375 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 23:00:10,375 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,385 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:10,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:10,385 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,385 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:10,385 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. started... 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 23:00:10,385 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:10,385 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:10,385 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. started... 2023-10-05 23:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:10,386 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fcd43b1097ce78ace1dc3fe5c3794eba 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 23:00:10,386 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f0556318cdaf7a36792ce7a5a56e692e 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 23:00:10,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:10,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:10,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:10,438 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:10,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:10,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:10,440 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:10,529 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c 2023-10-05 23:00:10,529 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896 2023-10-05 23:00:10,560 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/.tmp/cf/ba7db9ce01964b4ea1f785766b6e6dc5 2023-10-05 23:00:10,561 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/.tmp/cf/29ead0b1e9e64498a54006b15ba217d4 2023-10-05 23:00:10,572 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/.tmp/cf/29ead0b1e9e64498a54006b15ba217d4 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4 2023-10-05 23:00:10,572 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/.tmp/cf/ba7db9ce01964b4ea1f785766b6e6dc5 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5 2023-10-05 23:00:10,582 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5, entries=48, sequenceid=6, filesize=13.0 K 2023-10-05 23:00:10,583 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 23:00:10,587 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f0556318cdaf7a36792ce7a5a56e692e in 201ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:10,587 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fcd43b1097ce78ace1dc3fe5c3794eba in 202ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:10,588 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 23:00:10,588 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 23:00:10,590 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f0556318cdaf7a36792ce7a5a56e692e: 2023-10-05 23:00:10,590 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 23:00:10,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:10,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4] hfiles 2023-10-05 23:00:10,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 23:00:10,596 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcd43b1097ce78ace1dc3fe5c3794eba: 2023-10-05 23:00:10,596 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 23:00:10,596 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:10,596 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5] hfiles 2023-10-05 23:00:10,597 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 23:00:10,623 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. completed. 2023-10-05 23:00:10,623 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,624 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:10,624 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:10,625 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:10,626 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46597,1696546799886': 2023-10-05 23:00:10,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 23:00:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:10,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:10,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:10,642 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 23:00:10,942 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:10,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:10,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:10,944 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 23:00:11,023 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. completed. 2023-10-05 23:00:11,023 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 23:00:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:11,025 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 23:00:11,025 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,025 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:11,026 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 23:00:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:11,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 23:00:11,032 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 23:00:11,032 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:11,032 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:11,032 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 23:00:11,032 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,035 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:11,036 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,036 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,037 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:11,038 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,040 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:11,040 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 23:00:11,041 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:11,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 23:00:11,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:11,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,052 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:11,053 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,053 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:11,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 23:00:11,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:11,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:11,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:11,053 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:11,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 23:00:11,054 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:11,054 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:11,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:11,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,054 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:11,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:11,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896] mob files 2023-10-05 23:00:11,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c 2023-10-05 23:00:11,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896 2023-10-05 23:00:11,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 23:00:11,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 23:00:11,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,117 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 23:00:11,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696546810337Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696546811074 (+737 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696546811074Loading Region manifests for snaptb0-testExportWithTargetName at 1696546811074Writing data manifest for snaptb0-testExportWithTargetName at 1696546811079 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696546811101 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696546811116 (+15 ms) 2023-10-05 23:00:11,120 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 23:00:11,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 783 msec 2023-10-05 23:00:11,444 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:11,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 23:00:11,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:11,447 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447 2023-10-05 23:00:11,448 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44933, tgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447, rawTgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:11,490 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:11,491 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-573973025_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 23:00:11,491 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 23:00:11,512 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 23:00:11,588 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:11,589 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:11,590 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:11,590 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,559 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-2139823189005788922.jar 2023-10-05 23:00:12,560 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,560 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,627 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-85573068557509265.jar 2023-10-05 23:00:12,628 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,628 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,629 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:12,631 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:00:12,632 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:00:12,632 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:00:12,633 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:00:12,633 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:00:12,634 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:00:12,634 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:00:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:00:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:00:12,636 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:00:12,639 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:12,640 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:12,640 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:12,641 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:12,641 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:12,642 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:12,642 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:13,808 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:00:13,814 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 23:00:13,822 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 23:00:13,879 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:00:14,313 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:14,313 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:14,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0001_000001 (auth:SIMPLE) 2023-10-05 23:00:18,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0001_000001 (auth:SIMPLE) 2023-10-05 23:00:21,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0001_000001 (auth:SIMPLE) 2023-10-05 23:00:23,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0001_000001 (auth:SIMPLE) 2023-10-05 23:00:25,677 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:00:25,680 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:00:25,691 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 23:00:25,691 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:00:25,692 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:00:25,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 23:00:25,693 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 23:00:25,693 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 23:00:25,693 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/testExportWithTargetName 2023-10-05 23:00:25,694 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 23:00:25,694 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546811447/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 23:00:25,704 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 23:00:25,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 23:00:25,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:25,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546825721"}]},"ts":"1696546825721"} 2023-10-05 23:00:25,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 23:00:25,723 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 23:00:25,725 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 23:00:25,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, UNASSIGN}] 2023-10-05 23:00:25,729 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, UNASSIGN 2023-10-05 23:00:25,729 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, UNASSIGN 2023-10-05 23:00:25,730 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f0556318cdaf7a36792ce7a5a56e692e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:25,731 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fcd43b1097ce78ace1dc3fe5c3794eba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:25,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546825730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546825730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546825730"}]},"ts":"1696546825730"} 2023-10-05 23:00:25,731 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546825730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546825730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546825730"}]},"ts":"1696546825730"} 2023-10-05 23:00:25,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure f0556318cdaf7a36792ce7a5a56e692e, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:25,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure fcd43b1097ce78ace1dc3fe5c3794eba, server=jenkins-hbase4.apache.org,46597,1696546799886}] 2023-10-05 23:00:25,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 23:00:25,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:25,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fcd43b1097ce78ace1dc3fe5c3794eba, disabling compactions & flushes 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0556318cdaf7a36792ce7a5a56e692e, disabling compactions & flushes 2023-10-05 23:00:25,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:25,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. after waiting 0 ms 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. after waiting 0 ms 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:25,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:25,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:00:25,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:00:25,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:25,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:25,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba. 2023-10-05 23:00:25,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e. 2023-10-05 23:00:25,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fcd43b1097ce78ace1dc3fe5c3794eba: 2023-10-05 23:00:25,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0556318cdaf7a36792ce7a5a56e692e: 2023-10-05 23:00:25,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:25,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fcd43b1097ce78ace1dc3fe5c3794eba, regionState=CLOSED 2023-10-05 23:00:25,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:25,918 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546825918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546825918"}]},"ts":"1696546825918"} 2023-10-05 23:00:25,919 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f0556318cdaf7a36792ce7a5a56e692e, regionState=CLOSED 2023-10-05 23:00:25,919 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696546825919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546825919"}]},"ts":"1696546825919"} 2023-10-05 23:00:25,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-05 23:00:25,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure fcd43b1097ce78ace1dc3fe5c3794eba, server=jenkins-hbase4.apache.org,46597,1696546799886 in 187 msec 2023-10-05 23:00:25,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-05 23:00:25,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure f0556318cdaf7a36792ce7a5a56e692e, server=jenkins-hbase4.apache.org,43513,1696546799925 in 188 msec 2023-10-05 23:00:25,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fcd43b1097ce78ace1dc3fe5c3794eba, UNASSIGN in 196 msec 2023-10-05 23:00:25,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-05 23:00:25,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f0556318cdaf7a36792ce7a5a56e692e, UNASSIGN in 197 msec 2023-10-05 23:00:25,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546825928"}]},"ts":"1696546825928"} 2023-10-05 23:00:25,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 23:00:25,932 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 23:00:25,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-10-05 23:00:26,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 23:00:26,026 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 23:00:26,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 23:00:26,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,043 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 23:00:26,045 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,048 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 23:00:26,051 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:26,051 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:26,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 23:00:26,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 23:00:26,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 23:00:26,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 23:00:26,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 23:00:26,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 23:00:26,055 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:00:26,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 23:00:26,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 23:00:26,055 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:00:26,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,055 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 23:00:26,056 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:00:26,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/recovered.edits] 2023-10-05 23:00:26,057 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/recovered.edits] 2023-10-05 23:00:26,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 23:00:26,066 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/cf/29ead0b1e9e64498a54006b15ba217d4 2023-10-05 23:00:26,066 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/cf/ba7db9ce01964b4ea1f785766b6e6dc5 2023-10-05 23:00:26,070 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e/recovered.edits/9.seqid 2023-10-05 23:00:26,070 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba/recovered.edits/9.seqid 2023-10-05 23:00:26,071 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/f0556318cdaf7a36792ce7a5a56e692e 2023-10-05 23:00:26,071 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportWithTargetName/fcd43b1097ce78ace1dc3fe5c3794eba 2023-10-05 23:00:26,071 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 23:00:26,071 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 23:00:26,072 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 23:00:26,077 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100514fcfa3aced04b4e9895643d6e1b307c 2023-10-05 23:00:26,079 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e43b5218fb274687aa32ea4050d82896 2023-10-05 23:00:26,079 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 23:00:26,082 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,111 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 23:00:26,114 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 23:00:26,116 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,116 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 23:00:26,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546826116"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:26,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546826116"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:26,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:00:26,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f0556318cdaf7a36792ce7a5a56e692e, NAME => 'testtb-testExportWithTargetName,,1696546807870.f0556318cdaf7a36792ce7a5a56e692e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fcd43b1097ce78ace1dc3fe5c3794eba, NAME => 'testtb-testExportWithTargetName,1,1696546807870.fcd43b1097ce78ace1dc3fe5c3794eba.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:00:26,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 23:00:26,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546826119"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:26,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 23:00:26,123 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 23:00:26,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 89 msec 2023-10-05 23:00:26,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 23:00:26,163 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 23:00:26,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 23:00:26,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 23:00:26,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 23:00:26,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 23:00:26,226 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 704) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:36117 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:33573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:34800 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:44785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1713581619_1 at /127.0.0.1:56788 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:56094 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1713581619_1 at /127.0.0.1:44270 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 307), ProcessCount=168 (was 168), AvailableMemoryMB=6173 (was 6803) 2023-10-05 23:00:26,226 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-05 23:00:26,250 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=168, AvailableMemoryMB=6172 2023-10-05 23:00:26,250 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-05 23:00:26,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:00:26,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:26,258 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:00:26,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 23:00:26,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 23:00:26,261 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:00:26,264 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,265 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef empty. 2023-10-05 23:00:26,265 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,265 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,265 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 empty. 2023-10-05 23:00:26,266 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,266 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 23:00:26,279 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:26,281 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 556ead1b8f20c40dbe000289901d38ef, NAME => 'testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:26,281 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd7694dea3c81789b0e998112802d431, NAME => 'testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:26,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:26,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 556ead1b8f20c40dbe000289901d38ef, disabling compactions & flushes 2023-10-05 23:00:26,306 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. after waiting 0 ms 2023-10-05 23:00:26,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 556ead1b8f20c40dbe000289901d38ef: 2023-10-05 23:00:26,308 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:26,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fd7694dea3c81789b0e998112802d431, disabling compactions & flushes 2023-10-05 23:00:26,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. after waiting 0 ms 2023-10-05 23:00:26,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fd7694dea3c81789b0e998112802d431: 2023-10-05 23:00:26,312 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:00:26,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546826312"}]},"ts":"1696546826312"} 2023-10-05 23:00:26,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546826312"}]},"ts":"1696546826312"} 2023-10-05 23:00:26,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:00:26,317 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:00:26,317 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546826317"}]},"ts":"1696546826317"} 2023-10-05 23:00:26,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 23:00:26,323 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:26,324 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:26,324 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:26,324 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:26,324 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:26,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, ASSIGN}] 2023-10-05 23:00:26,327 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, ASSIGN 2023-10-05 23:00:26,327 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, ASSIGN 2023-10-05 23:00:26,328 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:00:26,328 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46597,1696546799886; forceNewPlan=false, retain=false 2023-10-05 23:00:26,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 23:00:26,478 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:00:26,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fd7694dea3c81789b0e998112802d431, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:26,481 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=556ead1b8f20c40dbe000289901d38ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:26,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546826480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546826480"}]},"ts":"1696546826480"} 2023-10-05 23:00:26,481 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546826480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546826480"}]},"ts":"1696546826480"} 2023-10-05 23:00:26,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure fd7694dea3c81789b0e998112802d431, server=jenkins-hbase4.apache.org,46597,1696546799886}] 2023-10-05 23:00:26,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 556ead1b8f20c40dbe000289901d38ef, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:26,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 23:00:26,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd7694dea3c81789b0e998112802d431, NAME => 'testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:00:26,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 556ead1b8f20c40dbe000289901d38ef, NAME => 'testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. service=AccessControlService 2023-10-05 23:00:26,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. service=AccessControlService 2023-10-05 23:00:26,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:26,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:26,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,643 INFO [StoreOpener-fd7694dea3c81789b0e998112802d431-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,643 INFO [StoreOpener-556ead1b8f20c40dbe000289901d38ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,644 DEBUG [StoreOpener-fd7694dea3c81789b0e998112802d431-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf 2023-10-05 23:00:26,644 DEBUG [StoreOpener-fd7694dea3c81789b0e998112802d431-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf 2023-10-05 23:00:26,645 DEBUG [StoreOpener-556ead1b8f20c40dbe000289901d38ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf 2023-10-05 23:00:26,645 INFO [StoreOpener-fd7694dea3c81789b0e998112802d431-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd7694dea3c81789b0e998112802d431 columnFamilyName cf 2023-10-05 23:00:26,645 DEBUG [StoreOpener-556ead1b8f20c40dbe000289901d38ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf 2023-10-05 23:00:26,646 INFO [StoreOpener-556ead1b8f20c40dbe000289901d38ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 556ead1b8f20c40dbe000289901d38ef columnFamilyName cf 2023-10-05 23:00:26,647 INFO [StoreOpener-556ead1b8f20c40dbe000289901d38ef-1] regionserver.HStore(310): Store=556ead1b8f20c40dbe000289901d38ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:26,647 INFO [StoreOpener-fd7694dea3c81789b0e998112802d431-1] regionserver.HStore(310): Store=fd7694dea3c81789b0e998112802d431/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:26,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:26,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:26,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:26,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 556ead1b8f20c40dbe000289901d38ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69711778, jitterRate=0.03878644108772278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:26,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 556ead1b8f20c40dbe000289901d38ef: 2023-10-05 23:00:26,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:26,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd7694dea3c81789b0e998112802d431; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59319930, jitterRate=-0.1160641610622406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:26,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef., pid=31, masterSystemTime=1696546826637 2023-10-05 23:00:26,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd7694dea3c81789b0e998112802d431: 2023-10-05 23:00:26,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431., pid=30, masterSystemTime=1696546826636 2023-10-05 23:00:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=556ead1b8f20c40dbe000289901d38ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:26,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546826660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546826660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546826660"}]},"ts":"1696546826660"} 2023-10-05 23:00:26,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:26,661 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fd7694dea3c81789b0e998112802d431, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:26,663 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546826661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546826661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546826661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546826661"}]},"ts":"1696546826661"} 2023-10-05 23:00:26,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-05 23:00:26,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 556ead1b8f20c40dbe000289901d38ef, server=jenkins-hbase4.apache.org,43513,1696546799925 in 179 msec 2023-10-05 23:00:26,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-05 23:00:26,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure fd7694dea3c81789b0e998112802d431, server=jenkins-hbase4.apache.org,46597,1696546799886 in 183 msec 2023-10-05 23:00:26,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, ASSIGN in 344 msec 2023-10-05 23:00:26,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-05 23:00:26,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, ASSIGN in 347 msec 2023-10-05 23:00:26,674 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:00:26,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546826674"}]},"ts":"1696546826674"} 2023-10-05 23:00:26,676 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 23:00:26,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:00:26,678 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 23:00:26,680 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:00:26,682 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,682 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,682 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,682 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:26,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:26,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:26,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:26,684 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:26,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 429 msec 2023-10-05 23:00:26,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 23:00:26,864 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 23:00:26,867 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 23:00:26,867 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:26,869 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:26,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:26,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546826930 (current time:1696546826930). 2023-10-05 23:00:26,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:26,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x1e76bb7f to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:26,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff12a55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:26,946 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:26,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e76bb7f to 127.0.0.1:64387 2023-10-05 23:00:26,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:26,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x45d2219f to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e54d719, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:26,956 DEBUG [hconnection-0x891eb04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:26,957 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:26,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:26,964 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:26,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45d2219f to 127.0.0.1:64387 2023-10-05 23:00:26,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:26,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:00:26,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:26,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:26,970 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:26,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:26,973 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:26,974 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696547426974 2023-10-05 23:00:26,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:26,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 23:00:26,975 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:26,975 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:26,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:26,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:26,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-05 23:00:26,979 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:26,979 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696547426979 2023-10-05 23:00:27,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,003 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 23:00:27,003 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,005 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 23:00:27,005 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 23:00:27,005 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,005 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,008 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,008 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,008 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,008 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,009 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,009 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,010 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,010 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:27,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 23:00:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,012 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,012 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,012 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,013 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,013 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,016 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,023 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,024 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,024 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,024 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,024 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,024 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6686eeba[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 23:00:27,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6686eeba[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:27,029 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 23:00:27,029 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,030 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,030 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,030 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,031 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,031 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:27,031 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,031 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:27,031 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. started... 2023-10-05 23:00:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:27,032 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. started... 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd7694dea3c81789b0e998112802d431: 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 556ead1b8f20c40dbe000289901d38ef: 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:27,033 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. completed. 2023-10-05 23:00:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:27,055 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:27,055 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:27,055 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,055 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,055 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. completed. 2023-10-05 23:00:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,057 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46597,1696546799886': 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:27,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 23:00:27,069 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 23:00:27,069 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:27,069 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:27,069 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,070 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,071 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,072 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,073 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,074 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,074 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,075 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:00:27,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:27,076 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,076 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,077 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,077 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,080 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,080 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,080 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,080 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,081 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,080 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,081 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,081 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,081 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,081 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,082 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,081 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,082 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 23:00:27,082 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,083 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,083 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:27,083 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,083 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:00:27,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 23:00:27,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:27,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696546826974Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696546827093 (+119 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696546827093Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696546827093Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696546827098 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696546827122 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696546827130 (+8 ms) 2023-10-05 23:00:27,133 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:27,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 158 msec 2023-10-05 23:00:27,276 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:27,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:00:27,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:27,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:27,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46597] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:27,290 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 23:00:27,291 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:27,291 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:27,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:27,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546827302 (current time:1696546827302). 2023-10-05 23:00:27,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:27,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x7a177820 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:27,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b163937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:27,312 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a177820 to 127.0.0.1:64387 2023-10-05 23:00:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:27,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x4db48c2d to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:27,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@669674f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:27,324 DEBUG [hconnection-0x2236b4c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:27,327 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:27,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:27,332 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:27,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4db48c2d to 127.0.0.1:64387 2023-10-05 23:00:27,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:27,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:00:27,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:27,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:27,337 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:27,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:27,340 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:27,341 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696547427341 2023-10-05 23:00:27,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:00:27,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 23:00:27,341 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:27,342 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:27,344 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:00:27,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:27,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-05 23:00:27,346 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:27,347 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696547427347 2023-10-05 23:00:27,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 23:00:27,363 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 23:00:27,363 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,365 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 23:00:27,365 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 23:00:27,365 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,365 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,367 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,367 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,367 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,368 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,368 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,369 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,369 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 23:00:27,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 23:00:27,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 23:00:27,370 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,370 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,370 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,370 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,374 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,376 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,377 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 23:00:27,377 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 23:00:27,378 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 23:00:27,380 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,380 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,380 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,381 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,381 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7496809[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 23:00:27,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7496809[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:27,386 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 23:00:27,386 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:27,388 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:27,388 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:27,388 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,388 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. started... 2023-10-05 23:00:27,388 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. started... 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,388 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 556ead1b8f20c40dbe000289901d38ef 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 23:00:27,388 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:27,389 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fd7694dea3c81789b0e998112802d431 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 23:00:27,389 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,389 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,422 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753 2023-10-05 23:00:27,427 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008 2023-10-05 23:00:27,437 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/.tmp/cf/df87eb47bd214742b4e1f160c2b37a9e 2023-10-05 23:00:27,442 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:27,444 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/.tmp/cf/df87eb47bd214742b4e1f160c2b37a9e as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e 2023-10-05 23:00:27,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:00:27,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:27,444 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:27,449 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/.tmp/cf/748b21134b5b44c9a75cc73ed37cc853 2023-10-05 23:00:27,455 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/.tmp/cf/748b21134b5b44c9a75cc73ed37cc853 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853 2023-10-05 23:00:27,461 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 23:00:27,462 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 556ead1b8f20c40dbe000289901d38ef in 74ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:27,462 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 23:00:27,463 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 556ead1b8f20c40dbe000289901d38ef: 2023-10-05 23:00:27,463 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 23:00:27,463 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:27,463 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e] hfiles 2023-10-05 23:00:27,463 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e for snapshot=snaptb0-testExportFileSystemState 2023-10-05 23:00:27,465 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 23:00:27,466 INFO [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fd7694dea3c81789b0e998112802d431 in 78ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:27,468 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd7694dea3c81789b0e998112802d431: 2023-10-05 23:00:27,468 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 23:00:27,468 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:27,468 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853] hfiles 2023-10-05 23:00:27,468 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853 for snapshot=snaptb0-testExportFileSystemState 2023-10-05 23:00:27,484 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. completed. 2023-10-05 23:00:27,484 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:27,484 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:27,484 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:27,484 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,485 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:27,488 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. completed. 2023-10-05 23:00:27,488 DEBUG [rs(jenkins-hbase4.apache.org,46597,1696546799886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 23:00:27,489 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:27,491 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,491 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,491 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,492 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,494 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 23:00:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 23:00:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46597,1696546799886': 2023-10-05 23:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 23:00:27,502 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 23:00:27,502 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:27,502 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:27,502 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 23:00:27,502 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:27,504 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,504 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,505 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:27,505 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,506 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,506 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:27,507 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:27,509 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 23:00:27,513 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,513 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,516 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,517 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:27,517 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:27,517 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,517 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,518 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,518 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 23:00:27,517 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:27,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 23:00:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,519 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:27,518 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:27,519 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 23:00:27,519 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:27,519 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753] mob files 2023-10-05 23:00:27,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008 2023-10-05 23:00:27,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753 2023-10-05 23:00:27,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 23:00:27,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 23:00:27,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696546827341Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696546827534 (+193 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696546827534Loading Region manifests for snaptb0-testExportFileSystemState at 1696546827534Writing data manifest for snaptb0-testExportFileSystemState at 1696546827539 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696546827548 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696546827558 (+10 ms) 2023-10-05 23:00:27,561 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 23:00:27,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 219 msec 2023-10-05 23:00:27,644 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:27,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:00:27,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:27,646 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646 2023-10-05 23:00:27,646 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44933, tgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646, rawTgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:27,670 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:27,670 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1126062714_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,670 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 23:00:27,682 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 23:00:27,714 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:27,715 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:27,715 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:27,716 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,602 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-8963915171190074534.jar 2023-10-05 23:00:28,603 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,603 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,670 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-1504479175937090700.jar 2023-10-05 23:00:28,670 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,671 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,671 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,671 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,672 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,672 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:28,673 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:00:28,673 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:00:28,674 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:00:28,674 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:00:28,674 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:00:28,675 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:00:28,675 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:00:28,676 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:00:28,676 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:00:28,676 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:00:28,677 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:28,677 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:28,678 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:28,678 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:28,679 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:28,679 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:28,680 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:29,165 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:00:29,168 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 23:00:29,170 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 23:00:30,081 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:30,081 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:30,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0001_000001 (auth:SIMPLE) 2023-10-05 23:00:30,776 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0002_000001 (auth:SIMPLE) 2023-10-05 23:00:31,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:00:35,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0002_000001 (auth:SIMPLE) 2023-10-05 23:00:37,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0002_000001 (auth:SIMPLE) 2023-10-05 23:00:40,308 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0002_000001 (auth:SIMPLE) 2023-10-05 23:00:41,373 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:00:41,374 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:00:41,382 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 23:00:41,382 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:00:41,383 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:00:41,383 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 23:00:41,383 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 23:00:41,384 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 23:00:41,384 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 23:00:41,384 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 23:00:41,384 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546827646/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 23:00:41,392 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 23:00:41,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 23:00:41,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 23:00:41,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546841398"}]},"ts":"1696546841398"} 2023-10-05 23:00:41,399 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 23:00:41,401 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 23:00:41,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, UNASSIGN}] 2023-10-05 23:00:41,404 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, UNASSIGN 2023-10-05 23:00:41,405 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, UNASSIGN 2023-10-05 23:00:41,406 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fd7694dea3c81789b0e998112802d431, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:41,406 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=556ead1b8f20c40dbe000289901d38ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:41,406 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546841406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546841406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546841406"}]},"ts":"1696546841406"} 2023-10-05 23:00:41,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546841406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546841406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546841406"}]},"ts":"1696546841406"} 2023-10-05 23:00:41,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure fd7694dea3c81789b0e998112802d431, server=jenkins-hbase4.apache.org,46597,1696546799886}] 2023-10-05 23:00:41,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 556ead1b8f20c40dbe000289901d38ef, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:41,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 23:00:41,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:41,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:41,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd7694dea3c81789b0e998112802d431, disabling compactions & flushes 2023-10-05 23:00:41,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 556ead1b8f20c40dbe000289901d38ef, disabling compactions & flushes 2023-10-05 23:00:41,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:41,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:41,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:41,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:41,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. after waiting 0 ms 2023-10-05 23:00:41,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:41,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. after waiting 0 ms 2023-10-05 23:00:41,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:00:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:00:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:00:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef. 2023-10-05 23:00:41,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431. 2023-10-05 23:00:41,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd7694dea3c81789b0e998112802d431: 2023-10-05 23:00:41,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 556ead1b8f20c40dbe000289901d38ef: 2023-10-05 23:00:41,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:41,573 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fd7694dea3c81789b0e998112802d431, regionState=CLOSED 2023-10-05 23:00:41,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:41,573 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546841573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546841573"}]},"ts":"1696546841573"} 2023-10-05 23:00:41,574 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=556ead1b8f20c40dbe000289901d38ef, regionState=CLOSED 2023-10-05 23:00:41,574 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696546841574"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546841574"}]},"ts":"1696546841574"} 2023-10-05 23:00:41,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-05 23:00:41,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure fd7694dea3c81789b0e998112802d431, server=jenkins-hbase4.apache.org,46597,1696546799886 in 167 msec 2023-10-05 23:00:41,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-05 23:00:41,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 556ead1b8f20c40dbe000289901d38ef, server=jenkins-hbase4.apache.org,43513,1696546799925 in 167 msec 2023-10-05 23:00:41,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fd7694dea3c81789b0e998112802d431, UNASSIGN in 175 msec 2023-10-05 23:00:41,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-05 23:00:41,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=556ead1b8f20c40dbe000289901d38ef, UNASSIGN in 176 msec 2023-10-05 23:00:41,581 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546841581"}]},"ts":"1696546841581"} 2023-10-05 23:00:41,582 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 23:00:41,584 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 23:00:41,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-10-05 23:00:41,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 23:00:41,700 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 23:00:41,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 23:00:41,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,705 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 23:00:41,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,707 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 23:00:41,711 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:41,711 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:41,712 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,712 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,712 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 23:00:41,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 23:00:41,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 23:00:41,713 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,713 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/recovered.edits] 2023-10-05 23:00:41,714 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/recovered.edits] 2023-10-05 23:00:41,714 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 23:00:41,715 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:41,715 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-10-05 23:00:41,715 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:00:41,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 23:00:41,720 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/cf/df87eb47bd214742b4e1f160c2b37a9e 2023-10-05 23:00:41,724 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/cf/748b21134b5b44c9a75cc73ed37cc853 2023-10-05 23:00:41,724 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef/recovered.edits/9.seqid 2023-10-05 23:00:41,725 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/556ead1b8f20c40dbe000289901d38ef 2023-10-05 23:00:41,727 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431/recovered.edits/9.seqid 2023-10-05 23:00:41,727 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemState/fd7694dea3c81789b0e998112802d431 2023-10-05 23:00:41,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 23:00:41,728 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 23:00:41,729 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 23:00:41,733 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310054ed5d149495644ef9b83aa5a4ef1f008 2023-10-05 23:00:41,735 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8b3d6504d2143eea125aac0441c9753 2023-10-05 23:00:41,735 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 23:00:41,738 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,741 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 23:00:41,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 23:00:41,745 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,745 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 23:00:41,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546841745"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:41,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546841745"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:41,748 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:00:41,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 556ead1b8f20c40dbe000289901d38ef, NAME => 'testtb-testExportFileSystemState,,1696546826252.556ead1b8f20c40dbe000289901d38ef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fd7694dea3c81789b0e998112802d431, NAME => 'testtb-testExportFileSystemState,1,1696546826252.fd7694dea3c81789b0e998112802d431.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:00:41,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 23:00:41,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546841748"}]},"ts":"9223372036854775807"} 2023-10-05 23:00:41,750 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 23:00:41,752 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 23:00:41,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-10-05 23:00:41,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 23:00:41,817 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 23:00:41,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 23:00:41,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 23:00:41,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 23:00:41,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 23:00:41,859 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:37229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_49528612_1 at /127.0.0.1:54214 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:38654 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:41245 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:55084 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_49528612_1 at /127.0.0.1:38624 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:54238 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 281), ProcessCount=168 (was 168), AvailableMemoryMB=6008 (was 6172) 2023-10-05 23:00:41,860 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-05 23:00:41,879 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=168, AvailableMemoryMB=6008 2023-10-05 23:00:41,879 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-05 23:00:41,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:00:41,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:00:41,885 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:00:41,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 23:00:41,886 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:00:41,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 23:00:41,889 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:41,889 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:41,889 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab empty. 2023-10-05 23:00:41,889 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e empty. 2023-10-05 23:00:41,890 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:41,890 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:41,890 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 23:00:41,903 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 23:00:41,904 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => fcb48144ee49ca733fe710c595d3a5ab, NAME => 'testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:41,904 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0ed9beaabb9dfa41435cbbc13c3df7e, NAME => 'testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a0ed9beaabb9dfa41435cbbc13c3df7e, disabling compactions & flushes 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing fcb48144ee49ca733fe710c595d3a5ab, disabling compactions & flushes 2023-10-05 23:00:41,917 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:41,917 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. after waiting 0 ms 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. after waiting 0 ms 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:41,917 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:41,917 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:41,918 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:41,918 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for fcb48144ee49ca733fe710c595d3a5ab: 2023-10-05 23:00:41,918 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a0ed9beaabb9dfa41435cbbc13c3df7e: 2023-10-05 23:00:41,920 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:00:41,921 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546841921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546841921"}]},"ts":"1696546841921"} 2023-10-05 23:00:41,921 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546841921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546841921"}]},"ts":"1696546841921"} 2023-10-05 23:00:41,924 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:00:41,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:00:41,925 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546841925"}]},"ts":"1696546841925"} 2023-10-05 23:00:41,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 23:00:41,931 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:00:41,932 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:00:41,932 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:00:41,932 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:00:41,932 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:00:41,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, ASSIGN}] 2023-10-05 23:00:41,938 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, ASSIGN 2023-10-05 23:00:41,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, ASSIGN 2023-10-05 23:00:41,938 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:00:41,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:00:41,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 23:00:42,089 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:00:42,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0ed9beaabb9dfa41435cbbc13c3df7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fcb48144ee49ca733fe710c595d3a5ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546842091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546842091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546842091"}]},"ts":"1696546842091"} 2023-10-05 23:00:42,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546842091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546842091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546842091"}]},"ts":"1696546842091"} 2023-10-05 23:00:42,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure a0ed9beaabb9dfa41435cbbc13c3df7e, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:00:42,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure fcb48144ee49ca733fe710c595d3a5ab, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:00:42,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 23:00:42,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0ed9beaabb9dfa41435cbbc13c3df7e, NAME => 'testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:00:42,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. service=AccessControlService 2023-10-05 23:00:42,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcb48144ee49ca733fe710c595d3a5ab, NAME => 'testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. service=AccessControlService 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,254 INFO [StoreOpener-a0ed9beaabb9dfa41435cbbc13c3df7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,255 INFO [StoreOpener-fcb48144ee49ca733fe710c595d3a5ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,256 DEBUG [StoreOpener-a0ed9beaabb9dfa41435cbbc13c3df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf 2023-10-05 23:00:42,256 DEBUG [StoreOpener-fcb48144ee49ca733fe710c595d3a5ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf 2023-10-05 23:00:42,256 DEBUG [StoreOpener-a0ed9beaabb9dfa41435cbbc13c3df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf 2023-10-05 23:00:42,256 DEBUG [StoreOpener-fcb48144ee49ca733fe710c595d3a5ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf 2023-10-05 23:00:42,256 INFO [StoreOpener-a0ed9beaabb9dfa41435cbbc13c3df7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0ed9beaabb9dfa41435cbbc13c3df7e columnFamilyName cf 2023-10-05 23:00:42,256 INFO [StoreOpener-fcb48144ee49ca733fe710c595d3a5ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcb48144ee49ca733fe710c595d3a5ab columnFamilyName cf 2023-10-05 23:00:42,258 INFO [StoreOpener-a0ed9beaabb9dfa41435cbbc13c3df7e-1] regionserver.HStore(310): Store=a0ed9beaabb9dfa41435cbbc13c3df7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:42,258 INFO [StoreOpener-fcb48144ee49ca733fe710c595d3a5ab-1] regionserver.HStore(310): Store=fcb48144ee49ca733fe710c595d3a5ab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:00:42,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:00:42,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:00:42,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:42,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:00:42,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0ed9beaabb9dfa41435cbbc13c3df7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68714614, jitterRate=0.023927539587020874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:42,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0ed9beaabb9dfa41435cbbc13c3df7e: 2023-10-05 23:00:42,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fcb48144ee49ca733fe710c595d3a5ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65888254, jitterRate=-0.018188506364822388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:00:42,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fcb48144ee49ca733fe710c595d3a5ab: 2023-10-05 23:00:42,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e., pid=45, masterSystemTime=1696546842246 2023-10-05 23:00:42,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab., pid=46, masterSystemTime=1696546842246 2023-10-05 23:00:42,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,267 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0ed9beaabb9dfa41435cbbc13c3df7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,267 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546842267"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546842267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546842267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546842267"}]},"ts":"1696546842267"} 2023-10-05 23:00:42,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=fcb48144ee49ca733fe710c595d3a5ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546842268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546842268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546842268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546842268"}]},"ts":"1696546842268"} 2023-10-05 23:00:42,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-05 23:00:42,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure a0ed9beaabb9dfa41435cbbc13c3df7e, server=jenkins-hbase4.apache.org,43513,1696546799925 in 175 msec 2023-10-05 23:00:42,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-05 23:00:42,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure fcb48144ee49ca733fe710c595d3a5ab, server=jenkins-hbase4.apache.org,37651,1696546799838 in 175 msec 2023-10-05 23:00:42,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, ASSIGN in 339 msec 2023-10-05 23:00:42,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-05 23:00:42,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, ASSIGN in 340 msec 2023-10-05 23:00:42,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:00:42,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546842274"}]},"ts":"1696546842274"} 2023-10-05 23:00:42,276 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 23:00:42,278 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:00:42,279 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 23:00:42,280 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 23:00:42,282 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:42,282 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:42,282 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:42,282 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:00:42,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:42,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:42,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:42,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 23:00:42,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-10-05 23:00:42,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 23:00:42,490 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 23:00:42,492 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 23:00:42,493 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,495 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:42,502 DEBUG [hconnection-0x5f092bc3-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,506 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546842511 (current time:1696546842511). 2023-10-05 23:00:42,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:42,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x3021e28a to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9d6fa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:42,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,525 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3021e28a to 127.0.0.1:64387 2023-10-05 23:00:42,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:42,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0059cd to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:42,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@410ad135, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:42,536 DEBUG [hconnection-0x17bc46c9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,539 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,545 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e0059cd to 127.0.0.1:64387 2023-10-05 23:00:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 23:00:42,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:42,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,550 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:42,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,552 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,553 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696547442553 2023-10-05 23:00:42,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 23:00:42,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,554 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:42,554 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:42,555 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:42,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 23:00:42,557 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:42,558 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696547442558 2023-10-05 23:00:42,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,568 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 23:00:42,568 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,569 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 23:00:42,569 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 23:00:42,570 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,570 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,572 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,572 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,572 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,572 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,573 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,573 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,573 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,573 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 23:00:42,574 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,574 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,575 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,576 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,575 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,576 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,576 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,581 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,581 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,581 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,583 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64614af5[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 23:00:42,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64614af5[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:42,587 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 23:00:42,587 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,589 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:42,589 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:42,589 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. started... 2023-10-05 23:00:42,589 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:42,589 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. started... 2023-10-05 23:00:42,590 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ed9beaabb9dfa41435cbbc13c3df7e: 2023-10-05 23:00:42,589 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,591 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:42,591 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcb48144ee49ca733fe710c595d3a5ab: 2023-10-05 23:00:42,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:42,591 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:42,591 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,592 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:42,592 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:00:42,598 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:42,598 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:42,598 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:42,613 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. completed. 2023-10-05 23:00:42,613 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:42,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,617 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. completed. 2023-10-05 23:00:42,617 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,619 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,619 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:42,619 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:00:42,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 23:00:42,627 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 23:00:42,627 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:42,627 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:42,627 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,627 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,631 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,632 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,632 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,634 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,634 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,635 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,638 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:42,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 23:00:42,638 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,640 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,640 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,640 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,640 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,640 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:42,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:00:42,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,654 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:42,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 23:00:42,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:42,656 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:42,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 23:00:42,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 23:00:42,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696546842553Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696546842648 (+95 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696546842648Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696546842648Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696546842652 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696546842665 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696546842672 (+7 ms) 2023-10-05 23:00:42,675 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:42,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 121 msec 2023-10-05 23:00:42,856 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:42,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 23:00:42,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:42,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37651] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:42,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:00:42,864 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 23:00:42,864 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,864 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:00:42,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546842875 (current time:1696546842875). 2023-10-05 23:00:42,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:00:42,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x642da2cf to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:42,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f832f42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:42,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,892 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x642da2cf to 127.0.0.1:64387 2023-10-05 23:00:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:42,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x56a0a245 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:00:42,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f125984, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:00:42,903 DEBUG [hconnection-0x794d941b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,905 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:00:42,910 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:00:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56a0a245 to 127.0.0.1:64387 2023-10-05 23:00:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:00:42,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 23:00:42,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:00:42,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,916 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:00:42,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,919 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,919 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696547442919 2023-10-05 23:00:42,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 23:00:42,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 23:00:42,921 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:00:42,921 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:00:42,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:42,922 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 23:00:42,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-05 23:00:42,925 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:42,925 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696547442925 2023-10-05 23:00:42,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 23:00:42,936 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 23:00:42,936 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,938 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 23:00:42,938 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 23:00:42,938 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,938 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,940 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,940 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,940 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,940 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,941 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,941 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,942 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,942 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 23:00:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 23:00:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 23:00:42,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 23:00:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 23:00:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 23:00:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:00:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,947 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 23:00:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 23:00:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 23:00:42,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,950 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,952 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,952 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:00:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d783de[Count = 1] remaining members to acquire global barrier 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:42,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 23:00:42,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d783de[Count = 0] remaining members to acquire global barrier 2023-10-05 23:00:42,957 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 23:00:42,957 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:42,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:00:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,960 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:42,960 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:00:42,960 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:42,960 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:42,960 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:42,960 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. started... 2023-10-05 23:00:42,960 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 23:00:42,960 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0ed9beaabb9dfa41435cbbc13c3df7e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 23:00:42,960 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:00:42,960 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:00:42,960 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:42,960 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. started... 2023-10-05 23:00:42,961 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fcb48144ee49ca733fe710c595d3a5ab 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 23:00:42,961 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:42,962 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:42,962 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:42,989 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a 2023-10-05 23:00:42,990 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c 2023-10-05 23:00:43,001 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/.tmp/cf/706782f6b5974fd69e669d1de43ea326 2023-10-05 23:00:43,003 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/.tmp/cf/3aea98caa68a4212b780ce0dba63683d 2023-10-05 23:00:43,007 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/.tmp/cf/706782f6b5974fd69e669d1de43ea326 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326 2023-10-05 23:00:43,008 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/.tmp/cf/3aea98caa68a4212b780ce0dba63683d as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d 2023-10-05 23:00:43,012 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 23:00:43,013 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for fcb48144ee49ca733fe710c595d3a5ab in 52ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:43,013 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 23:00:43,014 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fcb48144ee49ca733fe710c595d3a5ab: 2023-10-05 23:00:43,014 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d, entries=46, sequenceid=6, filesize=12.5 K 2023-10-05 23:00:43,014 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 23:00:43,014 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:43,014 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326] hfiles 2023-10-05 23:00:43,014 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 23:00:43,015 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a0ed9beaabb9dfa41435cbbc13c3df7e in 55ms, sequenceid=6, compaction requested=false 2023-10-05 23:00:43,017 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ed9beaabb9dfa41435cbbc13c3df7e: 2023-10-05 23:00:43,017 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 23:00:43,017 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:00:43,017 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d] hfiles 2023-10-05 23:00:43,017 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d for snapshot=snaptb0-testConsecutiveExports 2023-10-05 23:00:43,021 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:43,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 23:00:43,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:00:43,023 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:00:43,034 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. completed. 2023-10-05 23:00:43,034 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:00:43,035 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. completed. 2023-10-05 23:00:43,035 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:00:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:00:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:00:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 23:00:43,036 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:00:43,037 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:43,038 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 23:00:43,039 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:43,040 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 23:00:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:00:43,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 23:00:43,047 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 23:00:43,047 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:00:43,047 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:00:43,047 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 23:00:43,047 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:00:43,049 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,049 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,049 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,049 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,050 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,049 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,050 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:00:43,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,051 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,051 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:00:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:00:43,053 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 23:00:43,054 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,054 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,061 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:00:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:43,061 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 23:00:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:00:43,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 23:00:43,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 23:00:43,063 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,063 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,064 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a] mob files 2023-10-05 23:00:43,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c 2023-10-05 23:00:43,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a 2023-10-05 23:00:43,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 23:00:43,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 23:00:43,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,103 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696546842920Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696546843076 (+156 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696546843076Loading Region manifests for snaptb0-testConsecutiveExports at 1696546843076Writing data manifest for snaptb0-testConsecutiveExports at 1696546843082 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696546843093 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696546843102 (+9 ms) 2023-10-05 23:00:43,105 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 23:00:43,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-10-05 23:00:43,223 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:00:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 23:00:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:00:43,224 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224 2023-10-05 23:00:43,225 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:43,246 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:43,246 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a21a3c7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,246 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 23:00:43,255 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:43,266 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:43,266 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:43,267 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:43,267 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,152 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-925361058718761354.jar 2023-10-05 23:00:44,153 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,153 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,219 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-1481168632264177682.jar 2023-10-05 23:00:44,220 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,220 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,220 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,221 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,221 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,221 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:44,222 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:00:44,222 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:00:44,222 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:00:44,223 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:00:44,223 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:00:44,224 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:00:44,224 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:00:44,224 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:00:44,225 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:00:44,225 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:00:44,226 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:44,226 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:44,227 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:44,227 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:44,227 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:44,228 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:44,228 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:44,645 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:00:44,647 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 23:00:44,649 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 23:00:46,481 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:46,481 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:00:46,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0002_000001 (auth:SIMPLE) 2023-10-05 23:00:47,147 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:00:47,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0003_000001 (auth:SIMPLE) 2023-10-05 23:00:50,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0003_000001 (auth:SIMPLE) 2023-10-05 23:00:53,203 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0003_000001 (auth:SIMPLE) 2023-10-05 23:00:55,548 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0003_000001 (auth:SIMPLE) 2023-10-05 23:00:56,815 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:00:56,816 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:00:56,820 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 23:00:56,820 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:00:56,821 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:00:56,821 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 23:00:56,823 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 23:00:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 23:00:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e3249e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 23:00:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 23:00:56,824 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 23:00:56,825 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:56,847 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:00:56,847 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@544c5892, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:56,847 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 23:00:56,860 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 23:00:56,872 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:56,873 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:56,873 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:56,874 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,744 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-2830785607863491752.jar 2023-10-05 23:00:57,744 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,745 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-2591264624975590960.jar 2023-10-05 23:00:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,812 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,812 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,812 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,813 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,813 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:00:57,814 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:00:57,814 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:00:57,814 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:00:57,815 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:00:57,815 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:00:57,816 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:00:57,816 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:00:57,816 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:00:57,816 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:00:57,817 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:00:57,818 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:57,818 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:57,818 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:57,819 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:57,819 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:00:57,819 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:57,820 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:00:58,174 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:00:58,177 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 23:00:58,179 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 23:01:01,721 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:01,721 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:01,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0003_000001 (auth:SIMPLE) 2023-10-05 23:01:02,493 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0004_000001 (auth:SIMPLE) 2023-10-05 23:01:06,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0004_000001 (auth:SIMPLE) 2023-10-05 23:01:08,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0004_000001 (auth:SIMPLE) 2023-10-05 23:01:10,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0004_000001 (auth:SIMPLE) 2023-10-05 23:01:12,384 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:01:12,385 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:01:12,388 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 23:01:12,388 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:01:12,388 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:01:12,389 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 23:01:12,392 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 23:01:12,392 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 23:01:12,392 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e3249e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 23:01:12,393 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 23:01:12,393 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/local-export-1696546843224/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 23:01:12,405 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 23:01:12,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 23:01:12,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 23:01:12,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546872409"}]},"ts":"1696546872409"} 2023-10-05 23:01:12,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 23:01:12,412 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 23:01:12,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, UNASSIGN}] 2023-10-05 23:01:12,415 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, UNASSIGN 2023-10-05 23:01:12,415 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, UNASSIGN 2023-10-05 23:01:12,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=fcb48144ee49ca733fe710c595d3a5ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:12,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546872416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546872416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546872416"}]},"ts":"1696546872416"} 2023-10-05 23:01:12,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0ed9beaabb9dfa41435cbbc13c3df7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:12,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546872416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546872416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546872416"}]},"ts":"1696546872416"} 2023-10-05 23:01:12,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure fcb48144ee49ca733fe710c595d3a5ab, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:12,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure a0ed9beaabb9dfa41435cbbc13c3df7e, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:12,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 23:01:12,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:01:12,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fcb48144ee49ca733fe710c595d3a5ab, disabling compactions & flushes 2023-10-05 23:01:12,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:01:12,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:01:12,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. after waiting 0 ms 2023-10-05 23:01:12,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:01:12,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:01:12,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0ed9beaabb9dfa41435cbbc13c3df7e, disabling compactions & flushes 2023-10-05 23:01:12,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:01:12,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:01:12,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. after waiting 0 ms 2023-10-05 23:01:12,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:01:12,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:12,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:12,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:12,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:12,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab. 2023-10-05 23:01:12,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fcb48144ee49ca733fe710c595d3a5ab: 2023-10-05 23:01:12,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e. 2023-10-05 23:01:12,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0ed9beaabb9dfa41435cbbc13c3df7e: 2023-10-05 23:01:12,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:01:12,588 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=fcb48144ee49ca733fe710c595d3a5ab, regionState=CLOSED 2023-10-05 23:01:12,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546872588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546872588"}]},"ts":"1696546872588"} 2023-10-05 23:01:12,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:01:12,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0ed9beaabb9dfa41435cbbc13c3df7e, regionState=CLOSED 2023-10-05 23:01:12,590 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696546872589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546872589"}]},"ts":"1696546872589"} 2023-10-05 23:01:12,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-05 23:01:12,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure fcb48144ee49ca733fe710c595d3a5ab, server=jenkins-hbase4.apache.org,37651,1696546799838 in 173 msec 2023-10-05 23:01:12,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-05 23:01:12,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure a0ed9beaabb9dfa41435cbbc13c3df7e, server=jenkins-hbase4.apache.org,43513,1696546799925 in 173 msec 2023-10-05 23:01:12,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fcb48144ee49ca733fe710c595d3a5ab, UNASSIGN in 179 msec 2023-10-05 23:01:12,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-05 23:01:12,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0ed9beaabb9dfa41435cbbc13c3df7e, UNASSIGN in 180 msec 2023-10-05 23:01:12,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546872595"}]},"ts":"1696546872595"} 2023-10-05 23:01:12,596 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 23:01:12,599 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 23:01:12,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-10-05 23:01:12,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 23:01:12,711 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 23:01:12,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 23:01:12,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,715 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 23:01:12,716 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,718 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 23:01:12,722 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,722 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,722 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,722 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 23:01:12,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 23:01:12,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 23:01:12,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 23:01:12,723 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:01:12,723 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:01:12,723 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,723 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,723 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,723 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:12,723 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:12,724 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 23:01:12,724 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:12,724 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:12,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 23:01:12,725 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/recovered.edits] 2023-10-05 23:01:12,726 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/recovered.edits] 2023-10-05 23:01:12,730 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/cf/3aea98caa68a4212b780ce0dba63683d 2023-10-05 23:01:12,730 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/cf/706782f6b5974fd69e669d1de43ea326 2023-10-05 23:01:12,733 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e/recovered.edits/9.seqid 2023-10-05 23:01:12,734 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab/recovered.edits/9.seqid 2023-10-05 23:01:12,734 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/a0ed9beaabb9dfa41435cbbc13c3df7e 2023-10-05 23:01:12,734 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testConsecutiveExports/fcb48144ee49ca733fe710c595d3a5ab 2023-10-05 23:01:12,734 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 23:01:12,735 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 23:01:12,735 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 23:01:12,739 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005a63a7291a7a94a13a125d6b610f4f83c 2023-10-05 23:01:12,740 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b217ce1ac7e14a9ea9950519af1e0a8a 2023-10-05 23:01:12,740 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 23:01:12,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,745 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 23:01:12,750 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 23:01:12,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 23:01:12,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546872751"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:12,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546872751"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:12,752 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:01:12,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fcb48144ee49ca733fe710c595d3a5ab, NAME => 'testtb-testConsecutiveExports,,1696546841880.fcb48144ee49ca733fe710c595d3a5ab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0ed9beaabb9dfa41435cbbc13c3df7e, NAME => 'testtb-testConsecutiveExports,1,1696546841880.a0ed9beaabb9dfa41435cbbc13c3df7e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:01:12,753 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 23:01:12,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546872753"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:12,754 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 23:01:12,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 23:01:12,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-10-05 23:01:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 23:01:12,826 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 23:01:12,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 23:01:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 23:01:12,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 23:01:12,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 23:01:12,865 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 761), OpenFileDescriptor=899 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 233), ProcessCount=168 (was 168), AvailableMemoryMB=5853 (was 6008) 2023-10-05 23:01:12,865 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-05 23:01:12,883 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=168, AvailableMemoryMB=5852 2023-10-05 23:01:12,883 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-05 23:01:12,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:01:12,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:12,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:01:12,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 23:01:12,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:01:12,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 23:01:12,893 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:12,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:12,893 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 empty. 2023-10-05 23:01:12,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 empty. 2023-10-05 23:01:12,894 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:12,894 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:12,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 23:01:12,903 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 23:01:12,904 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f95cd99201230529649b0995c8ace8b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:12,905 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => e49d1808482cfabb09954cce6bc44a50, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:12,916 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:12,916 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:12,916 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing e49d1808482cfabb09954cce6bc44a50, disabling compactions & flushes 2023-10-05 23:01:12,916 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f95cd99201230529649b0995c8ace8b1, disabling compactions & flushes 2023-10-05 23:01:12,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:12,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. after waiting 0 ms 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:12,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for e49d1808482cfabb09954cce6bc44a50: 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. after waiting 0 ms 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:12,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:12,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f95cd99201230529649b0995c8ace8b1: 2023-10-05 23:01:12,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:01:12,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546872920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546872920"}]},"ts":"1696546872920"} 2023-10-05 23:01:12,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546872920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546872920"}]},"ts":"1696546872920"} 2023-10-05 23:01:12,928 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:01:12,928 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:01:12,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546872928"}]},"ts":"1696546872928"} 2023-10-05 23:01:12,930 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 23:01:12,933 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:01:12,935 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:01:12,935 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:01:12,935 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:01:12,935 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:01:12,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, ASSIGN}] 2023-10-05 23:01:12,938 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, ASSIGN 2023-10-05 23:01:12,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, ASSIGN 2023-10-05 23:01:12,939 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:01:12,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:01:12,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 23:01:13,089 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:01:13,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f95cd99201230529649b0995c8ace8b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e49d1808482cfabb09954cce6bc44a50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546873092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546873092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546873092"}]},"ts":"1696546873092"} 2023-10-05 23:01:13,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546873092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546873092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546873092"}]},"ts":"1696546873092"} 2023-10-05 23:01:13,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure f95cd99201230529649b0995c8ace8b1, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:13,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure e49d1808482cfabb09954cce6bc44a50, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:13,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 23:01:13,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f95cd99201230529649b0995c8ace8b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:01:13,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e49d1808482cfabb09954cce6bc44a50, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. service=AccessControlService 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. service=AccessControlService 2023-10-05 23:01:13,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:13,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:13,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,255 INFO [StoreOpener-f95cd99201230529649b0995c8ace8b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,255 INFO [StoreOpener-e49d1808482cfabb09954cce6bc44a50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,260 DEBUG [StoreOpener-f95cd99201230529649b0995c8ace8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf 2023-10-05 23:01:13,260 DEBUG [StoreOpener-e49d1808482cfabb09954cce6bc44a50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf 2023-10-05 23:01:13,260 DEBUG [StoreOpener-e49d1808482cfabb09954cce6bc44a50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf 2023-10-05 23:01:13,260 DEBUG [StoreOpener-f95cd99201230529649b0995c8ace8b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf 2023-10-05 23:01:13,261 INFO [StoreOpener-e49d1808482cfabb09954cce6bc44a50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e49d1808482cfabb09954cce6bc44a50 columnFamilyName cf 2023-10-05 23:01:13,261 INFO [StoreOpener-f95cd99201230529649b0995c8ace8b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f95cd99201230529649b0995c8ace8b1 columnFamilyName cf 2023-10-05 23:01:13,263 INFO [StoreOpener-f95cd99201230529649b0995c8ace8b1-1] regionserver.HStore(310): Store=f95cd99201230529649b0995c8ace8b1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:13,263 INFO [StoreOpener-e49d1808482cfabb09954cce6bc44a50-1] regionserver.HStore(310): Store=e49d1808482cfabb09954cce6bc44a50/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:13,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:13,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:13,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:13,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:13,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f95cd99201230529649b0995c8ace8b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67961233, jitterRate=0.012701287865638733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:13,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f95cd99201230529649b0995c8ace8b1: 2023-10-05 23:01:13,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e49d1808482cfabb09954cce6bc44a50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65231864, jitterRate=-0.02796947956085205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:13,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e49d1808482cfabb09954cce6bc44a50: 2023-10-05 23:01:13,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50., pid=61, masterSystemTime=1696546873249 2023-10-05 23:01:13,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1., pid=60, masterSystemTime=1696546873248 2023-10-05 23:01:13,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e49d1808482cfabb09954cce6bc44a50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546873273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546873273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546873273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546873273"}]},"ts":"1696546873273"} 2023-10-05 23:01:13,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f95cd99201230529649b0995c8ace8b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,274 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546873274"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546873274"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546873274"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546873274"}]},"ts":"1696546873274"} 2023-10-05 23:01:13,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-05 23:01:13,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure e49d1808482cfabb09954cce6bc44a50, server=jenkins-hbase4.apache.org,37651,1696546799838 in 177 msec 2023-10-05 23:01:13,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-05 23:01:13,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure f95cd99201230529649b0995c8ace8b1, server=jenkins-hbase4.apache.org,43513,1696546799925 in 182 msec 2023-10-05 23:01:13,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, ASSIGN in 342 msec 2023-10-05 23:01:13,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-05 23:01:13,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, ASSIGN in 344 msec 2023-10-05 23:01:13,281 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:01:13,282 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546873282"}]},"ts":"1696546873282"} 2023-10-05 23:01:13,283 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 23:01:13,286 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:01:13,286 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 23:01:13,288 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 23:01:13,290 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:13,290 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:13,290 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:13,290 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:13,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:13,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:13,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:13,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:13,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 406 msec 2023-10-05 23:01:13,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 23:01:13,494 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 23:01:13,497 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,497 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,499 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:13,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546873510 (current time:1696546873510). 2023-10-05 23:01:13,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:13,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x0df97c2e to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:13,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18edb462, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:13,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,521 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df97c2e to 127.0.0.1:64387 2023-10-05 23:01:13,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:13,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x20035b07 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@665d4b25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:13,532 DEBUG [hconnection-0x13e6ad28-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,534 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,541 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20035b07 to 127.0.0.1:64387 2023-10-05 23:01:13,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:13,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 23:01:13,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:13,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,546 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,548 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,549 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696547473549 2023-10-05 23:01:13,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,550 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:13,550 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:13,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,552 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-05 23:01:13,554 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,554 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696547473554 2023-10-05 23:01:13,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,563 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 23:01:13,563 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,565 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 23:01:13,565 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 23:01:13,565 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,565 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,567 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,567 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,567 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,567 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,568 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,569 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,569 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,570 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,573 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,573 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,575 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67755880[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 23:01:13,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67755880[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:13,579 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 23:01:13,579 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. started... 2023-10-05 23:01:13,581 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f95cd99201230529649b0995c8ace8b1: 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,581 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,581 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:13,581 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. started... 2023-10-05 23:01:13,582 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:13,583 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e49d1808482cfabb09954cce6bc44a50: 2023-10-05 23:01:13,583 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,583 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:13,583 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,592 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. completed. 2023-10-05 23:01:13,592 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,592 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:13,592 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:13,592 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,592 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. completed. 2023-10-05 23:01:13,593 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,593 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,595 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,595 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,597 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:13,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 23:01:13,605 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 23:01:13,606 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:13,606 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:13,606 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,606 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,608 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,608 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,609 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,610 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,611 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,612 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,612 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,615 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,616 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,616 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:13,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:01:13,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 23:01:13,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,650 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696546873549Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696546873631 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696546873631Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696546873631Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696546873636 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696546873643 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696546873650 (+7 ms) 2023-10-05 23:01:13,652 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:13,653 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 23:01:13,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:13,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 103 msec 2023-10-05 23:01:13,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:13,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37651] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:13,660 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,660 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,660 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:13,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546873670 (current time:1696546873670). 2023-10-05 23:01:13,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:13,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x01e6329e to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:13,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7331bc27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:13,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,682 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e6329e to 127.0.0.1:64387 2023-10-05 23:01:13,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:13,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x51c6a81e to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:13,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6104127a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:13,691 DEBUG [hconnection-0x1f2a5af9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,693 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:13,699 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51c6a81e to 127.0.0.1:64387 2023-10-05 23:01:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 23:01:13,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:13,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,704 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:13,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,706 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,706 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696547473706 2023-10-05 23:01:13,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 23:01:13,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,708 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:13,708 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:13,709 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 23:01:13,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 23:01:13,711 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,711 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696547473711 2023-10-05 23:01:13,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,721 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 23:01:13,721 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,722 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 23:01:13,722 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 23:01:13,722 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,722 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,725 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,725 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,725 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,725 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,726 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,726 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,726 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 23:01:13,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,729 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:13,731 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,730 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 23:01:13,732 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 23:01:13,734 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,734 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,734 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,734 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,735 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,735 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bb06d47[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 23:01:13,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bb06d47[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:13,739 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 23:01:13,739 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,740 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,741 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,741 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 23:01:13,741 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. started... 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:13,741 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,741 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f95cd99201230529649b0995c8ace8b1 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:13,741 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. started... 2023-10-05 23:01:13,741 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,741 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:13,742 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e49d1808482cfabb09954cce6bc44a50 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-05 23:01:13,741 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,762 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b 2023-10-05 23:01:13,762 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e 2023-10-05 23:01:13,769 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/.tmp/cf/9a31c144a672438eba1a55915bc6afdb 2023-10-05 23:01:13,770 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/.tmp/cf/8645770cd92d497382bf4cc3bdf84b4f 2023-10-05 23:01:13,775 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/.tmp/cf/9a31c144a672438eba1a55915bc6afdb as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb 2023-10-05 23:01:13,775 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/.tmp/cf/8645770cd92d497382bf4cc3bdf84b4f as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f 2023-10-05 23:01:13,780 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb, entries=49, sequenceid=6, filesize=13.9 K 2023-10-05 23:01:13,780 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f, entries=1, sequenceid=6, filesize=5.1 K 2023-10-05 23:01:13,780 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for e49d1808482cfabb09954cce6bc44a50 in 39ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:13,781 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 23:01:13,781 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for f95cd99201230529649b0995c8ace8b1 in 40ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:13,781 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 23:01:13,784 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e49d1808482cfabb09954cce6bc44a50: 2023-10-05 23:01:13,784 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f95cd99201230529649b0995c8ace8b1: 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb] hfiles 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f] hfiles 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,785 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,793 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. completed. 2023-10-05 23:01:13,793 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:13,793 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. completed. 2023-10-05 23:01:13,793 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:13,793 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 23:01:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,796 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,797 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,797 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 23:01:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:13,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:13,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 23:01:13,804 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 23:01:13,804 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:13,804 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:13,804 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,804 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:13,809 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:13,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 23:01:13,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:13,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,811 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,810 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,811 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,811 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:13,813 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,814 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,814 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,816 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,817 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,817 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:13,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:13,818 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,818 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:13,818 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,819 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:13,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,819 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:13,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,819 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:13,819 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:13,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:13,819 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:13,820 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,820 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e] mob files 2023-10-05 23:01:13,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b 2023-10-05 23:01:13,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e 2023-10-05 23:01:13,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 23:01:13,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,858 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:13,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696546873707Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696546873832 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696546873832Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696546873832Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696546873837 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696546873850 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696546873857 (+7 ms) 2023-10-05 23:01:13,861 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 23:01:13,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 153 msec 2023-10-05 23:01:14,010 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:14,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 23:01:14,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:14,040 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:01:14,043 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:01:14,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37651] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 23:01:14,045 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:01:14,048 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:01:14,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 23:01:14,049 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 23:01:14,052 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 23:01:14,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46597] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 23:01:14,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 23:01:14,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:14,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:01:14,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 23:01:14,058 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:01:14,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 23:01:14,060 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,061 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,061 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a empty. 2023-10-05 23:01:14,061 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e empty. 2023-10-05 23:01:14,062 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,062 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,062 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 23:01:14,072 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 23:01:14,073 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 59193959eb2a6cb5c5a733c1e40c0f2e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:14,074 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 04599bc6c78f65dbabb07d683c27001a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 59193959eb2a6cb5c5a733c1e40c0f2e, disabling compactions & flushes 2023-10-05 23:01:14,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. after waiting 0 ms 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:14,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 04599bc6c78f65dbabb07d683c27001a, disabling compactions & flushes 2023-10-05 23:01:14,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 59193959eb2a6cb5c5a733c1e40c0f2e: 2023-10-05 23:01:14,086 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. after waiting 0 ms 2023-10-05 23:01:14,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,086 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 04599bc6c78f65dbabb07d683c27001a: 2023-10-05 23:01:14,088 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:01:14,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546874089"}]},"ts":"1696546874089"} 2023-10-05 23:01:14,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546874089"}]},"ts":"1696546874089"} 2023-10-05 23:01:14,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:01:14,092 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:01:14,092 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546874092"}]},"ts":"1696546874092"} 2023-10-05 23:01:14,093 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 23:01:14,097 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:01:14,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:01:14,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:01:14,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:01:14,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:01:14,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, ASSIGN}] 2023-10-05 23:01:14,101 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, ASSIGN 2023-10-05 23:01:14,101 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, ASSIGN 2023-10-05 23:01:14,101 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:01:14,101 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:01:14,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 23:01:14,252 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:01:14,254 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=59193959eb2a6cb5c5a733c1e40c0f2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:14,254 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=04599bc6c78f65dbabb07d683c27001a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:14,255 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546874254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546874254"}]},"ts":"1696546874254"} 2023-10-05 23:01:14,255 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546874254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546874254"}]},"ts":"1696546874254"} 2023-10-05 23:01:14,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 59193959eb2a6cb5c5a733c1e40c0f2e, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:14,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 04599bc6c78f65dbabb07d683c27001a, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:14,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 23:01:14,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59193959eb2a6cb5c5a733c1e40c0f2e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 23:01:14,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04599bc6c78f65dbabb07d683c27001a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 23:01:14,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. service=AccessControlService 2023-10-05 23:01:14,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. service=AccessControlService 2023-10-05 23:01:14,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:14,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:14,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:14,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:14,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,414 INFO [StoreOpener-59193959eb2a6cb5c5a733c1e40c0f2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,414 INFO [StoreOpener-04599bc6c78f65dbabb07d683c27001a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,415 DEBUG [StoreOpener-59193959eb2a6cb5c5a733c1e40c0f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf 2023-10-05 23:01:14,415 DEBUG [StoreOpener-04599bc6c78f65dbabb07d683c27001a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf 2023-10-05 23:01:14,415 DEBUG [StoreOpener-04599bc6c78f65dbabb07d683c27001a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf 2023-10-05 23:01:14,415 DEBUG [StoreOpener-59193959eb2a6cb5c5a733c1e40c0f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf 2023-10-05 23:01:14,416 INFO [StoreOpener-04599bc6c78f65dbabb07d683c27001a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04599bc6c78f65dbabb07d683c27001a columnFamilyName cf 2023-10-05 23:01:14,416 INFO [StoreOpener-59193959eb2a6cb5c5a733c1e40c0f2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59193959eb2a6cb5c5a733c1e40c0f2e columnFamilyName cf 2023-10-05 23:01:14,416 INFO [StoreOpener-04599bc6c78f65dbabb07d683c27001a-1] regionserver.HStore(310): Store=04599bc6c78f65dbabb07d683c27001a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:14,417 INFO [StoreOpener-59193959eb2a6cb5c5a733c1e40c0f2e-1] regionserver.HStore(310): Store=59193959eb2a6cb5c5a733c1e40c0f2e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:14,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:14,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:14,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59193959eb2a6cb5c5a733c1e40c0f2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72284731, jitterRate=0.07712642848491669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:14,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04599bc6c78f65dbabb07d683c27001a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63538064, jitterRate=-0.05320906639099121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:14,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59193959eb2a6cb5c5a733c1e40c0f2e: 2023-10-05 23:01:14,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04599bc6c78f65dbabb07d683c27001a: 2023-10-05 23:01:14,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e., pid=69, masterSystemTime=1696546874408 2023-10-05 23:01:14,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a., pid=70, masterSystemTime=1696546874408 2023-10-05 23:01:14,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=04599bc6c78f65dbabb07d683c27001a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:14,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546874426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546874426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546874426"}]},"ts":"1696546874426"} 2023-10-05 23:01:14,426 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=59193959eb2a6cb5c5a733c1e40c0f2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:14,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546874426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546874426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546874426"}]},"ts":"1696546874426"} 2023-10-05 23:01:14,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-05 23:01:14,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 04599bc6c78f65dbabb07d683c27001a, server=jenkins-hbase4.apache.org,43513,1696546799925 in 170 msec 2023-10-05 23:01:14,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-05 23:01:14,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, ASSIGN in 331 msec 2023-10-05 23:01:14,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 59193959eb2a6cb5c5a733c1e40c0f2e, server=jenkins-hbase4.apache.org,37651,1696546799838 in 172 msec 2023-10-05 23:01:14,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-05 23:01:14,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, ASSIGN in 332 msec 2023-10-05 23:01:14,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:01:14,433 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546874433"}]},"ts":"1696546874433"} 2023-10-05 23:01:14,434 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 23:01:14,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:01:14,468 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 23:01:14,470 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 23:01:14,472 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:14,472 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:14,472 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:14,472 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:14,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 419 msec 2023-10-05 23:01:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 23:01:14,663 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 23:01:14,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a], force=true 2023-10-05 23:01:14,693 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a], force=true 2023-10-05 23:01:14,693 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a], force=true 2023-10-05 23:01:14,693 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a], force=true 2023-10-05 23:01:14,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 23:01:14,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, UNASSIGN}] 2023-10-05 23:01:14,718 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, UNASSIGN 2023-10-05 23:01:14,718 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, UNASSIGN 2023-10-05 23:01:14,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=04599bc6c78f65dbabb07d683c27001a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:14,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=59193959eb2a6cb5c5a733c1e40c0f2e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:14,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546874719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546874719"}]},"ts":"1696546874719"} 2023-10-05 23:01:14,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546874719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546874719"}]},"ts":"1696546874719"} 2023-10-05 23:01:14,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 04599bc6c78f65dbabb07d683c27001a, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:14,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 59193959eb2a6cb5c5a733c1e40c0f2e, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:14,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 23:01:14,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04599bc6c78f65dbabb07d683c27001a, disabling compactions & flushes 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59193959eb2a6cb5c5a733c1e40c0f2e, disabling compactions & flushes 2023-10-05 23:01:14,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. after waiting 0 ms 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. after waiting 0 ms 2023-10-05 23:01:14,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 04599bc6c78f65dbabb07d683c27001a 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 23:01:14,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 59193959eb2a6cb5c5a733c1e40c0f2e 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 23:01:14,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/.tmp/cf/3b4aa41878ce4bbaba9de292066804de 2023-10-05 23:01:14,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/.tmp/cf/1cd655ad77c3469286b75a45aee24954 2023-10-05 23:01:14,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/.tmp/cf/1cd655ad77c3469286b75a45aee24954 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954 2023-10-05 23:01:14,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/.tmp/cf/3b4aa41878ce4bbaba9de292066804de as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de 2023-10-05 23:01:14,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 23:01:14,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 23:01:14,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 04599bc6c78f65dbabb07d683c27001a in 24ms, sequenceid=5, compaction requested=false 2023-10-05 23:01:14,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 59193959eb2a6cb5c5a733c1e40c0f2e in 24ms, sequenceid=5, compaction requested=false 2023-10-05 23:01:14,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 23:01:14,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 23:01:14,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 23:01:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 23:01:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:14,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e. 2023-10-05 23:01:14,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a. 2023-10-05 23:01:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59193959eb2a6cb5c5a733c1e40c0f2e: 2023-10-05 23:01:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04599bc6c78f65dbabb07d683c27001a: 2023-10-05 23:01:14,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:14,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=04599bc6c78f65dbabb07d683c27001a, regionState=CLOSED 2023-10-05 23:01:14,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546874914"}]},"ts":"1696546874914"} 2023-10-05 23:01:14,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:14,915 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=59193959eb2a6cb5c5a733c1e40c0f2e, regionState=CLOSED 2023-10-05 23:01:14,915 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696546874915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546874915"}]},"ts":"1696546874915"} 2023-10-05 23:01:14,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-05 23:01:14,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 04599bc6c78f65dbabb07d683c27001a, server=jenkins-hbase4.apache.org,43513,1696546799925 in 196 msec 2023-10-05 23:01:14,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-05 23:01:14,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 59193959eb2a6cb5c5a733c1e40c0f2e, server=jenkins-hbase4.apache.org,37651,1696546799838 in 195 msec 2023-10-05 23:01:14,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=04599bc6c78f65dbabb07d683c27001a, UNASSIGN in 201 msec 2023-10-05 23:01:14,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-05 23:01:14,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59193959eb2a6cb5c5a733c1e40c0f2e, UNASSIGN in 205 msec 2023-10-05 23:01:14,964 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 23:01:14,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874054.59193959eb2a6cb5c5a733c1e40c0f2e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:14,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696546874054.04599bc6c78f65dbabb07d683c27001a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:14,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:14,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 23:01:15,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, ASSIGN}] 2023-10-05 23:01:15,024 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, ASSIGN 2023-10-05 23:01:15,025 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:01:15,175 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 23:01:15,177 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=18aa91fc4596ac5e66576b9fd5738516, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,177 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696546875177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546875177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546875177"}]},"ts":"1696546875177"} 2023-10-05 23:01:15,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 18aa91fc4596ac5e66576b9fd5738516, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:15,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 23:01:15,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:15,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18aa91fc4596ac5e66576b9fd5738516, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.', STARTKEY => '', ENDKEY => ''} 2023-10-05 23:01:15,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. service=AccessControlService 2023-10-05 23:01:15,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:15,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:15,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/.regioninfo 2023-10-05 23:01:15,343 INFO [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,344 DEBUG [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf 2023-10-05 23:01:15,344 DEBUG [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf 2023-10-05 23:01:15,345 INFO [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18aa91fc4596ac5e66576b9fd5738516 columnFamilyName cf 2023-10-05 23:01:15,372 DEBUG [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] regionserver.HStore(539): loaded hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/1cd655ad77c3469286b75a45aee24954.59193959eb2a6cb5c5a733c1e40c0f2e->hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954-top 2023-10-05 23:01:15,378 DEBUG [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] regionserver.HStore(539): loaded hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/3b4aa41878ce4bbaba9de292066804de.04599bc6c78f65dbabb07d683c27001a->hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de-top 2023-10-05 23:01:15,379 INFO [StoreOpener-18aa91fc4596ac5e66576b9fd5738516-1] regionserver.HStore(310): Store=18aa91fc4596ac5e66576b9fd5738516/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:15,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18aa91fc4596ac5e66576b9fd5738516; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62899421, jitterRate=-0.06272558867931366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:15,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18aa91fc4596ac5e66576b9fd5738516: 2023-10-05 23:01:15,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516., pid=77, masterSystemTime=1696546875330 2023-10-05 23:01:15,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.,because compaction is disabled. 2023-10-05 23:01:15,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:15,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:15,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=18aa91fc4596ac5e66576b9fd5738516, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,388 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696546875388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546875388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546875388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546875388"}]},"ts":"1696546875388"} 2023-10-05 23:01:15,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 23:01:15,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 18aa91fc4596ac5e66576b9fd5738516, server=jenkins-hbase4.apache.org,37651,1696546799838 in 210 msec 2023-10-05 23:01:15,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 23:01:15,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, ASSIGN in 368 msec 2023-10-05 23:01:15,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[59193959eb2a6cb5c5a733c1e40c0f2e, 04599bc6c78f65dbabb07d683c27001a], force=true in 706 msec 2023-10-05 23:01:15,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 23:01:15,801 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 23:01:15,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 23:01:15,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546875802 (current time:1696546875802). 2023-10-05 23:01:15,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:15,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x41222da7 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:15,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d0d93a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:15,814 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41222da7 to 127.0.0.1:64387 2023-10-05 23:01:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:15,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x042405c0 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:15,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54bb4ff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:15,822 DEBUG [hconnection-0x255a0e13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:15,824 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:15,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:15,830 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:15,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x042405c0 to 127.0.0.1:64387 2023-10-05 23:01:15,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:15,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 23:01:15,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:15,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 23:01:15,834 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 23:01:15,836 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 23:01:15,837 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696547475837 2023-10-05 23:01:15,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 23:01:15,840 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:15,841 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 23:01:15,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 23:01:15,841 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:15,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-05 23:01:15,843 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 23:01:15,843 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696547475843 2023-10-05 23:01:15,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,857 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 23:01:15,857 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:15,858 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 23:01:15,858 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 23:01:15,859 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,859 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,860 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,860 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,860 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,860 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,861 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,861 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 23:01:15,862 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 23:01:15,862 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:15,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,862 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 23:01:15,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,864 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:15,864 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 23:01:15,864 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 23:01:15,866 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 23:01:15,866 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 23:01:15,866 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 23:01:15,868 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,868 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,868 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:15,868 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,869 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:15,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 23:01:15,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4568bc26[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:15,871 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 23:01:15,871 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 23:01:15,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,873 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 23:01:15,873 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:15,873 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 23:01:15,873 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. started... 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 23:01:15,873 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 23:01:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:15,875 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18aa91fc4596ac5e66576b9fd5738516: 2023-10-05 23:01:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:15,875 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,875 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:15,875 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/1cd655ad77c3469286b75a45aee24954.59193959eb2a6cb5c5a733c1e40c0f2e->hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954-top, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/3b4aa41878ce4bbaba9de292066804de.04599bc6c78f65dbabb07d683c27001a->hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de-top] hfiles 2023-10-05 23:01:15,875 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/1cd655ad77c3469286b75a45aee24954.59193959eb2a6cb5c5a733c1e40c0f2e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,876 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/3b4aa41878ce4bbaba9de292066804de.04599bc6c78f65dbabb07d683c27001a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 23:01:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 23:01:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 23:01:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 23:01:15,888 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. completed. 2023-10-05 23:01:15,888 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:15,888 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:15,888 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:15,888 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,888 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 23:01:15,888 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:15,894 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 23:01:15,894 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,894 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:15,894 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 23:01:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:15,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 23:01:15,897 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 23:01:15,897 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:15,897 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:15,897 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,897 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:15,899 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,899 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:15,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,899 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,899 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,899 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,900 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,900 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,901 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,902 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:15,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:15,904 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,904 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,904 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,907 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:15,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:15,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:15,907 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:15,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,908 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 23:01:15,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,929 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696546875837Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696546875907 (+70 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696546875907Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696546875910 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696546875921 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696546875928 (+7 ms) 2023-10-05 23:01:15,932 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 23:01:15,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-10-05 23:01:15,941 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:15,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 23:01:15,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:15,943 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943 2023-10-05 23:01:15,943 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44933, tgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943, rawTgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:15,975 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:15,975 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-934519784_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:15,975 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 23:01:15,984 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:16,000 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,000 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,001 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,001 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0004_000001 (auth:SIMPLE) 2023-10-05 23:01:16,878 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-6728803442731642820.jar 2023-10-05 23:01:16,878 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,879 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,945 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-9154603384143370372.jar 2023-10-05 23:01:16,945 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,946 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,946 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,947 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,947 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,947 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:16,948 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:01:16,948 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:01:16,948 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:01:16,949 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:01:16,949 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:01:16,949 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:01:16,950 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:01:16,950 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:01:16,950 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:01:16,951 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:01:16,951 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:16,952 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:16,952 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:16,954 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:17,298 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:01:17,300 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 23:01:17,302 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 23:01:17,357 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:17,357 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:17,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0005_000001 (auth:SIMPLE) 2023-10-05 23:01:18,163 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:01:21,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0005_000001 (auth:SIMPLE) 2023-10-05 23:01:23,709 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0005_000001 (auth:SIMPLE) 2023-10-05 23:01:26,069 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0005_000001 (auth:SIMPLE) 2023-10-05 23:01:27,455 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:01:27,458 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:01:27,466 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,467 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:01:27,467 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:01:27,467 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,468 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 23:01:27,468 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 23:01:27,468 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,468 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 23:01:27,468 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546875943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 23:01:27,475 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 23:01:27,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546887479"}]},"ts":"1696546887479"} 2023-10-05 23:01:27,481 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 23:01:27,482 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 23:01:27,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, UNASSIGN}] 2023-10-05 23:01:27,485 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, UNASSIGN 2023-10-05 23:01:27,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=18aa91fc4596ac5e66576b9fd5738516, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:27,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696546887485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546887485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546887485"}]},"ts":"1696546887485"} 2023-10-05 23:01:27,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 18aa91fc4596ac5e66576b9fd5738516, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:27,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 23:01:27,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:27,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18aa91fc4596ac5e66576b9fd5738516, disabling compactions & flushes 2023-10-05 23:01:27,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:27,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:27,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. after waiting 0 ms 2023-10-05 23:01:27,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:27,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 23:01:27,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:27,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516. 2023-10-05 23:01:27,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18aa91fc4596ac5e66576b9fd5738516: 2023-10-05 23:01:27,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:27,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=18aa91fc4596ac5e66576b9fd5738516, regionState=CLOSED 2023-10-05 23:01:27,653 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696546887652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546887652"}]},"ts":"1696546887652"} 2023-10-05 23:01:27,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 23:01:27,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 18aa91fc4596ac5e66576b9fd5738516, server=jenkins-hbase4.apache.org,37651,1696546799838 in 167 msec 2023-10-05 23:01:27,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 23:01:27,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18aa91fc4596ac5e66576b9fd5738516, UNASSIGN in 172 msec 2023-10-05 23:01:27,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546887657"}]},"ts":"1696546887657"} 2023-10-05 23:01:27,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 23:01:27,659 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 23:01:27,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-10-05 23:01:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 23:01:27,782 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 23:01:27,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,785 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,786 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,787 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,790 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:27,790 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:27,790 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:27,791 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,791 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,791 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,791 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 23:01:27,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 23:01:27,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 23:01:27,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 23:01:27,792 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/recovered.edits] 2023-10-05 23:01:27,793 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/recovered.edits] 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,793 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/recovered.edits] 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:27,793 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:27,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:27,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:27,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 23:01:27,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:27,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:27,798 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/1cd655ad77c3469286b75a45aee24954.59193959eb2a6cb5c5a733c1e40c0f2e to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/1cd655ad77c3469286b75a45aee24954.59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:27,798 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/cf/3b4aa41878ce4bbaba9de292066804de 2023-10-05 23:01:27,798 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/cf/1cd655ad77c3469286b75a45aee24954 2023-10-05 23:01:27,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/3b4aa41878ce4bbaba9de292066804de.04599bc6c78f65dbabb07d683c27001a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/cf/3b4aa41878ce4bbaba9de292066804de.04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:27,802 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/recovered.edits/8.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a/recovered.edits/8.seqid 2023-10-05 23:01:27,803 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/04599bc6c78f65dbabb07d683c27001a 2023-10-05 23:01:27,804 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/recovered.edits/12.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516/recovered.edits/12.seqid 2023-10-05 23:01:27,805 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18aa91fc4596ac5e66576b9fd5738516 2023-10-05 23:01:27,805 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/recovered.edits/8.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e/recovered.edits/8.seqid 2023-10-05 23:01:27,805 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59193959eb2a6cb5c5a733c1e40c0f2e 2023-10-05 23:01:27,805 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 23:01:27,808 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,810 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 23:01:27,812 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 23:01:27,812 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,813 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 23:01:27,813 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546887813"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:27,814 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 23:01:27,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18aa91fc4596ac5e66576b9fd5738516, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696546874055.18aa91fc4596ac5e66576b9fd5738516.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 23:01:27,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 23:01:27,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546887814"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:27,816 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 23:01:27,818 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:27,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-10-05 23:01:27,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 23:01:27,896 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 23:01:27,896 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:27,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:27,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:27,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 23:01:27,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546887901"}]},"ts":"1696546887901"} 2023-10-05 23:01:27,902 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 23:01:27,904 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 23:01:27,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, UNASSIGN}] 2023-10-05 23:01:27,906 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, UNASSIGN 2023-10-05 23:01:27,906 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, UNASSIGN 2023-10-05 23:01:27,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f95cd99201230529649b0995c8ace8b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:27,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e49d1808482cfabb09954cce6bc44a50, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:27,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546887907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546887907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546887907"}]},"ts":"1696546887907"} 2023-10-05 23:01:27,907 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546887907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546887907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546887907"}]},"ts":"1696546887907"} 2023-10-05 23:01:27,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f95cd99201230529649b0995c8ace8b1, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:27,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure e49d1808482cfabb09954cce6bc44a50, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:28,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 23:01:28,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:28,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f95cd99201230529649b0995c8ace8b1, disabling compactions & flushes 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e49d1808482cfabb09954cce6bc44a50, disabling compactions & flushes 2023-10-05 23:01:28,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:28,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. after waiting 0 ms 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. after waiting 0 ms 2023-10-05 23:01:28,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:28,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:28,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:28,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:28,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:28,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50. 2023-10-05 23:01:28,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1. 2023-10-05 23:01:28,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e49d1808482cfabb09954cce6bc44a50: 2023-10-05 23:01:28,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f95cd99201230529649b0995c8ace8b1: 2023-10-05 23:01:28,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:28,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f95cd99201230529649b0995c8ace8b1, regionState=CLOSED 2023-10-05 23:01:28,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546888078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546888078"}]},"ts":"1696546888078"} 2023-10-05 23:01:28,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:28,078 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e49d1808482cfabb09954cce6bc44a50, regionState=CLOSED 2023-10-05 23:01:28,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696546888078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546888078"}]},"ts":"1696546888078"} 2023-10-05 23:01:28,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-05 23:01:28,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f95cd99201230529649b0995c8ace8b1, server=jenkins-hbase4.apache.org,43513,1696546799925 in 171 msec 2023-10-05 23:01:28,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-05 23:01:28,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure e49d1808482cfabb09954cce6bc44a50, server=jenkins-hbase4.apache.org,37651,1696546799838 in 171 msec 2023-10-05 23:01:28,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f95cd99201230529649b0995c8ace8b1, UNASSIGN in 177 msec 2023-10-05 23:01:28,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-05 23:01:28,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e49d1808482cfabb09954cce6bc44a50, UNASSIGN in 178 msec 2023-10-05 23:01:28,083 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546888083"}]},"ts":"1696546888083"} 2023-10-05 23:01:28,084 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 23:01:28,086 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 23:01:28,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-10-05 23:01:28,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 23:01:28,203 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 23:01:28,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,208 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,211 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,211 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,211 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,211 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 23:01:28,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 23:01:28,212 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:28,212 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:28,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 23:01:28,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,213 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 23:01:28,214 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/recovered.edits] 2023-10-05 23:01:28,214 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/recovered.edits] 2023-10-05 23:01:28,217 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/cf/9a31c144a672438eba1a55915bc6afdb 2023-10-05 23:01:28,217 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/cf/8645770cd92d497382bf4cc3bdf84b4f 2023-10-05 23:01:28,220 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50/recovered.edits/9.seqid 2023-10-05 23:01:28,220 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1/recovered.edits/9.seqid 2023-10-05 23:01:28,220 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e49d1808482cfabb09954cce6bc44a50 2023-10-05 23:01:28,221 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f95cd99201230529649b0995c8ace8b1 2023-10-05 23:01:28,221 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 23:01:28,221 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 23:01:28,222 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 23:01:28,224 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310055b5adb1c6d5042ffb175e715ac89424b 2023-10-05 23:01:28,226 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310055b9dbcd518bf4dc897c769fcb0685c8e 2023-10-05 23:01:28,226 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 23:01:28,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,230 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 23:01:28,231 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 23:01:28,232 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,232 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 23:01:28,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546888232"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:28,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546888232"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:28,234 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:01:28,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f95cd99201230529649b0995c8ace8b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696546872885.f95cd99201230529649b0995c8ace8b1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e49d1808482cfabb09954cce6bc44a50, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696546872885.e49d1808482cfabb09954cce6bc44a50.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:01:28,234 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 23:01:28,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546888234"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:28,236 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 23:01:28,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-10-05 23:01:28,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 23:01:28,315 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 23:01:28,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 23:01:28,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 23:01:28,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 23:01:28,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 23:01:28,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 23:01:28,354 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:55244 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:55208 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_52628013_1 at /127.0.0.1:51464 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_52628013_1 at /127.0.0.1:55224 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:51480 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3957 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:37373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 211) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5763 (was 5852) 2023-10-05 23:01:28,355 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-05 23:01:28,373 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=168, AvailableMemoryMB=5763 2023-10-05 23:01:28,373 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-05 23:01:28,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:01:28,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:28,377 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:01:28,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 23:01:28,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:01:28,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 23:01:28,380 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,380 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,381 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 empty. 2023-10-05 23:01:28,381 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 empty. 2023-10-05 23:01:28,381 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,381 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,381 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 23:01:28,390 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 23:01:28,391 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c4ed734c8e38074dda99a71c02dc361, NAME => 'testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:28,391 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6ab3bee7fcad8ee75f4d22fdc3d658b4, NAME => 'testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:28,398 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:28,398 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:28,398 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6ab3bee7fcad8ee75f4d22fdc3d658b4, disabling compactions & flushes 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3c4ed734c8e38074dda99a71c02dc361, disabling compactions & flushes 2023-10-05 23:01:28,399 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,399 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. after waiting 0 ms 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. after waiting 0 ms 2023-10-05 23:01:28,399 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3c4ed734c8e38074dda99a71c02dc361: 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,399 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,399 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6ab3bee7fcad8ee75f4d22fdc3d658b4: 2023-10-05 23:01:28,401 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:01:28,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546888402"}]},"ts":"1696546888402"} 2023-10-05 23:01:28,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546888402"}]},"ts":"1696546888402"} 2023-10-05 23:01:28,404 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:01:28,404 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:01:28,404 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546888404"}]},"ts":"1696546888404"} 2023-10-05 23:01:28,406 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 23:01:28,409 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:01:28,410 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:01:28,410 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:01:28,410 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:01:28,410 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:01:28,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, ASSIGN}] 2023-10-05 23:01:28,412 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, ASSIGN 2023-10-05 23:01:28,412 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, ASSIGN 2023-10-05 23:01:28,413 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:01:28,413 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:01:28,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 23:01:28,563 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:01:28,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3c4ed734c8e38074dda99a71c02dc361, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:28,566 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6ab3bee7fcad8ee75f4d22fdc3d658b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:28,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546888566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546888566"}]},"ts":"1696546888566"} 2023-10-05 23:01:28,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546888566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546888566"}]},"ts":"1696546888566"} 2023-10-05 23:01:28,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 3c4ed734c8e38074dda99a71c02dc361, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:28,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 6ab3bee7fcad8ee75f4d22fdc3d658b4, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:28,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 23:01:28,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c4ed734c8e38074dda99a71c02dc361, NAME => 'testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ab3bee7fcad8ee75f4d22fdc3d658b4, NAME => 'testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. service=AccessControlService 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. service=AccessControlService 2023-10-05 23:01:28,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:28,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:28,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:28,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,725 INFO [StoreOpener-6ab3bee7fcad8ee75f4d22fdc3d658b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,725 INFO [StoreOpener-3c4ed734c8e38074dda99a71c02dc361-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,726 DEBUG [StoreOpener-6ab3bee7fcad8ee75f4d22fdc3d658b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf 2023-10-05 23:01:28,726 DEBUG [StoreOpener-6ab3bee7fcad8ee75f4d22fdc3d658b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf 2023-10-05 23:01:28,726 DEBUG [StoreOpener-3c4ed734c8e38074dda99a71c02dc361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf 2023-10-05 23:01:28,726 DEBUG [StoreOpener-3c4ed734c8e38074dda99a71c02dc361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf 2023-10-05 23:01:28,727 INFO [StoreOpener-6ab3bee7fcad8ee75f4d22fdc3d658b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ab3bee7fcad8ee75f4d22fdc3d658b4 columnFamilyName cf 2023-10-05 23:01:28,727 INFO [StoreOpener-3c4ed734c8e38074dda99a71c02dc361-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c4ed734c8e38074dda99a71c02dc361 columnFamilyName cf 2023-10-05 23:01:28,728 INFO [StoreOpener-6ab3bee7fcad8ee75f4d22fdc3d658b4-1] regionserver.HStore(310): Store=6ab3bee7fcad8ee75f4d22fdc3d658b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:28,728 INFO [StoreOpener-3c4ed734c8e38074dda99a71c02dc361-1] regionserver.HStore(310): Store=3c4ed734c8e38074dda99a71c02dc361/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:28,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:28,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:28,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:28,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:28,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ab3bee7fcad8ee75f4d22fdc3d658b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65360192, jitterRate=-0.02605724334716797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:28,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c4ed734c8e38074dda99a71c02dc361; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74812773, jitterRate=0.1147971898317337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:28,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ab3bee7fcad8ee75f4d22fdc3d658b4: 2023-10-05 23:01:28,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c4ed734c8e38074dda99a71c02dc361: 2023-10-05 23:01:28,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4., pid=94, masterSystemTime=1696546888720 2023-10-05 23:01:28,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361., pid=93, masterSystemTime=1696546888720 2023-10-05 23:01:28,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:28,737 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6ab3bee7fcad8ee75f4d22fdc3d658b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:28,737 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888737"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546888737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546888737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546888737"}]},"ts":"1696546888737"} 2023-10-05 23:01:28,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,737 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3c4ed734c8e38074dda99a71c02dc361, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:28,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546888737"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546888737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546888737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546888737"}]},"ts":"1696546888737"} 2023-10-05 23:01:28,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-05 23:01:28,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 6ab3bee7fcad8ee75f4d22fdc3d658b4, server=jenkins-hbase4.apache.org,43513,1696546799925 in 169 msec 2023-10-05 23:01:28,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-05 23:01:28,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 3c4ed734c8e38074dda99a71c02dc361, server=jenkins-hbase4.apache.org,37651,1696546799838 in 171 msec 2023-10-05 23:01:28,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, ASSIGN in 330 msec 2023-10-05 23:01:28,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-05 23:01:28,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, ASSIGN in 331 msec 2023-10-05 23:01:28,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:01:28,743 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546888743"}]},"ts":"1696546888743"} 2023-10-05 23:01:28,744 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 23:01:28,747 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:01:28,747 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 23:01:28,748 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:01:28,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:28,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:28,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:28,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:28,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:28,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-10-05 23:01:28,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 23:01:28,982 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 23:01:28,984 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:28,984 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:28,986 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:28,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546888996 (current time:1696546888996). 2023-10-05 23:01:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:28,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x5bce586e to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:29,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c828fae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:29,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,010 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bce586e to 127.0.0.1:64387 2023-10-05 23:01:29,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x200702c5 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:29,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9a32383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:29,018 DEBUG [hconnection-0x419432e6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,019 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,025 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x200702c5 to 127.0.0.1:64387 2023-10-05 23:01:29,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:29,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:01:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:29,029 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:29,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,034 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,035 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696547489035 2023-10-05 23:01:29,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:29,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:29,036 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:29,036 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:29,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,037 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 23:01:29,041 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,041 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696547489041 2023-10-05 23:01:29,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,049 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 23:01:29,049 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,050 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 23:01:29,050 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 23:01:29,050 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,050 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,058 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,058 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,058 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,058 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,058 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,058 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 23:01:29,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,060 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,060 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,061 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,061 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,060 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,061 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,061 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,061 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,062 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,063 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,062 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,063 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,063 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,063 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,065 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,066 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,067 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fab1e26[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 23:01:29,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fab1e26[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:29,072 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 23:01:29,072 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,074 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:29,074 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:29,075 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,075 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:29,074 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:29,075 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:29,075 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. started... 2023-10-05 23:01:29,075 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. started... 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c4ed734c8e38074dda99a71c02dc361: 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ab3bee7fcad8ee75f4d22fdc3d658b4: 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:29,076 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:29,078 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,078 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,078 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,090 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. completed. 2023-10-05 23:01:29,090 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:29,091 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. completed. 2023-10-05 23:01:29,091 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,092 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,095 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,095 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,095 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,095 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:29,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 23:01:29,102 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 23:01:29,102 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:29,102 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:29,102 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,102 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,104 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,105 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,105 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,107 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,107 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,107 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,111 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,112 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,112 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,111 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,112 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,113 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,113 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,115 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,115 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,115 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,115 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,115 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:01:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,136 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:29,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:01:29,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:01:29,138 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:01:29,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 23:01:29,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,139 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696546889035Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696546889122 (+87 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696546889122Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696546889122Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696546889126 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696546889133 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696546889138 (+5 ms) 2023-10-05 23:01:29,142 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 106 msec 2023-10-05 23:01:29,338 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:29,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:01:29,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:29,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37651] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:29,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:29,344 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:29,344 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:29,345 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:29,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:29,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546889354 (current time:1696546889354). 2023-10-05 23:01:29,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:29,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x7a45cefd to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:29,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@363f16f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:29,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,363 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a45cefd to 127.0.0.1:64387 2023-10-05 23:01:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:29,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x4e2c181b to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:29,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aca0505, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:29,371 DEBUG [hconnection-0x540c2017-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,373 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:29,378 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e2c181b to 127.0.0.1:64387 2023-10-05 23:01:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 23:01:29,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:29,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:29,381 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:29,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,384 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,384 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696547489384 2023-10-05 23:01:29,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:29,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 23:01:29,385 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:29,385 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:29,386 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 23:01:29,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 23:01:29,388 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,388 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696547489388 2023-10-05 23:01:29,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,397 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 23:01:29,397 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,398 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 23:01:29,398 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 23:01:29,399 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,399 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,400 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,401 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,401 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,401 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 23:01:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:29,403 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 23:01:29,409 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,409 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257ee0b[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 23:01:29,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257ee0b[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:29,413 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 23:01:29,413 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,417 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,417 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,417 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:29,418 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:29,418 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,418 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. started... 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:29,418 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c4ed734c8e38074dda99a71c02dc361 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-05 23:01:29,418 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,419 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:29,418 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:29,419 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. started... 2023-10-05 23:01:29,419 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ab3bee7fcad8ee75f4d22fdc3d658b4 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-05 23:01:29,419 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,419 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,420 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,437 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a 2023-10-05 23:01:29,437 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173 2023-10-05 23:01:29,444 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/.tmp/cf/a4d7a71d220a48508914024c3d064f0a 2023-10-05 23:01:29,444 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/.tmp/cf/7ad650003aae4c50a7def5ffe4b5d750 2023-10-05 23:01:29,449 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/.tmp/cf/a4d7a71d220a48508914024c3d064f0a as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a 2023-10-05 23:01:29,450 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/.tmp/cf/7ad650003aae4c50a7def5ffe4b5d750 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750 2023-10-05 23:01:29,454 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a, entries=44, sequenceid=6, filesize=12.6 K 2023-10-05 23:01:29,454 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750, entries=6, sequenceid=6, filesize=5.9 K 2023-10-05 23:01:29,455 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 6ab3bee7fcad8ee75f4d22fdc3d658b4 in 36ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:29,455 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 23:01:29,455 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 3c4ed734c8e38074dda99a71c02dc361 in 37ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:29,455 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 23:01:29,458 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ab3bee7fcad8ee75f4d22fdc3d658b4: 2023-10-05 23:01:29,458 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c4ed734c8e38074dda99a71c02dc361: 2023-10-05 23:01:29,458 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,458 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,458 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:29,459 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:29,459 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a] hfiles 2023-10-05 23:01:29,459 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750] hfiles 2023-10-05 23:01:29,459 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,459 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,465 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. completed. 2023-10-05 23:01:29,465 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:29,466 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. completed. 2023-10-05 23:01:29,466 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 23:01:29,466 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:29,467 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,467 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,469 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 23:01:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 23:01:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:29,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 23:01:29,475 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 23:01:29,475 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:29,475 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:29,475 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,475 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:29,478 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,478 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,479 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,480 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:29,480 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,481 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,483 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:29,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,483 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,484 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:29,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:29,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,484 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:29,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,485 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173] mob files 2023-10-05 23:01:29,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a 2023-10-05 23:01:29,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173 2023-10-05 23:01:29,486 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:01:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:01:29,487 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:01:29,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 23:01:29,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,512 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696546889384Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696546889492 (+108 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696546889492Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696546889492Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696546889496 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696546889504 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696546889511 (+7 ms) 2023-10-05 23:01:29,516 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 23:01:29,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 131 msec 2023-10-05 23:01:29,688 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:29,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 23:01:29,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:29,689 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689 2023-10-05 23:01:29,689 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44933, tgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689, rawTgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:29,711 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:29,711 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1734462375_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,711 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 23:01:29,716 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:29,734 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:29,735 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:29,735 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:29,735 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,613 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-5534982353569431320.jar 2023-10-05 23:01:30,613 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,614 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,680 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-2967668801745316038.jar 2023-10-05 23:01:30,680 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,680 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,681 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,681 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:01:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:01:30,683 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:01:30,683 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:01:30,683 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:01:30,684 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:01:30,684 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:01:30,685 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:01:30,685 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:01:30,685 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:01:30,686 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:30,686 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:30,687 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:30,687 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:30,687 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:30,688 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:30,688 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:31,024 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:01:31,026 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 23:01:32,250 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:32,250 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:32,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0005_000001 (auth:SIMPLE) 2023-10-05 23:01:32,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0006_000001 (auth:SIMPLE) 2023-10-05 23:01:33,259 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:01:36,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0006_000001 (auth:SIMPLE) 2023-10-05 23:01:39,361 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:01:39,362 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:01:39,367 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:39,367 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:01:39,368 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:01:39,368 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:39,368 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 23:01:39,368 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 23:01:39,368 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:39,369 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 23:01:39,369 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546889689/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 23:01:39,375 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 23:01:39,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546899380"}]},"ts":"1696546899380"} 2023-10-05 23:01:39,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 23:01:39,383 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 23:01:39,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, UNASSIGN}] 2023-10-05 23:01:39,386 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, UNASSIGN 2023-10-05 23:01:39,386 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, UNASSIGN 2023-10-05 23:01:39,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3c4ed734c8e38074dda99a71c02dc361, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:39,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6ab3bee7fcad8ee75f4d22fdc3d658b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:39,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546899386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546899386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546899386"}]},"ts":"1696546899386"} 2023-10-05 23:01:39,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546899386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546899386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546899386"}]},"ts":"1696546899386"} 2023-10-05 23:01:39,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 3c4ed734c8e38074dda99a71c02dc361, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:39,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 6ab3bee7fcad8ee75f4d22fdc3d658b4, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:39,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 23:01:39,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:39,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ab3bee7fcad8ee75f4d22fdc3d658b4, disabling compactions & flushes 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c4ed734c8e38074dda99a71c02dc361, disabling compactions & flushes 2023-10-05 23:01:39,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:39,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. after waiting 0 ms 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. after waiting 0 ms 2023-10-05 23:01:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:39,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:39,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:39,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:39,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:39,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4. 2023-10-05 23:01:39,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ab3bee7fcad8ee75f4d22fdc3d658b4: 2023-10-05 23:01:39,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361. 2023-10-05 23:01:39,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c4ed734c8e38074dda99a71c02dc361: 2023-10-05 23:01:39,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:39,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3c4ed734c8e38074dda99a71c02dc361, regionState=CLOSED 2023-10-05 23:01:39,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546899552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546899552"}]},"ts":"1696546899552"} 2023-10-05 23:01:39,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:39,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6ab3bee7fcad8ee75f4d22fdc3d658b4, regionState=CLOSED 2023-10-05 23:01:39,553 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696546899553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546899553"}]},"ts":"1696546899553"} 2023-10-05 23:01:39,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 23:01:39,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 3c4ed734c8e38074dda99a71c02dc361, server=jenkins-hbase4.apache.org,37651,1696546799838 in 166 msec 2023-10-05 23:01:39,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 23:01:39,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 6ab3bee7fcad8ee75f4d22fdc3d658b4, server=jenkins-hbase4.apache.org,43513,1696546799925 in 166 msec 2023-10-05 23:01:39,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c4ed734c8e38074dda99a71c02dc361, UNASSIGN in 171 msec 2023-10-05 23:01:39,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-05 23:01:39,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ab3bee7fcad8ee75f4d22fdc3d658b4, UNASSIGN in 172 msec 2023-10-05 23:01:39,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546899558"}]},"ts":"1696546899558"} 2023-10-05 23:01:39,559 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 23:01:39,561 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 23:01:39,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-05 23:01:39,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 23:01:39,682 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 23:01:39,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,686 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,686 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,688 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,691 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:39,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:39,692 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/recovered.edits] 2023-10-05 23:01:39,693 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/recovered.edits] 2023-10-05 23:01:39,693 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,694 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,694 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,694 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 23:01:39,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 23:01:39,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 23:01:39,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:39,696 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:39,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 23:01:39,698 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/cf/7ad650003aae4c50a7def5ffe4b5d750 2023-10-05 23:01:39,698 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/cf/a4d7a71d220a48508914024c3d064f0a 2023-10-05 23:01:39,701 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361/recovered.edits/9.seqid 2023-10-05 23:01:39,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4/recovered.edits/9.seqid 2023-10-05 23:01:39,702 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c4ed734c8e38074dda99a71c02dc361 2023-10-05 23:01:39,702 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ab3bee7fcad8ee75f4d22fdc3d658b4 2023-10-05 23:01:39,702 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 23:01:39,702 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 23:01:39,703 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 23:01:39,706 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005f110caf3d28147ee9b0b518d95573d6a 2023-10-05 23:01:39,707 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a34a366e79b842a883e22e85ed487173 2023-10-05 23:01:39,708 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 23:01:39,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,712 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 23:01:39,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 23:01:39,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 23:01:39,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546899715"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:39,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546899715"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:39,718 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:01:39,718 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c4ed734c8e38074dda99a71c02dc361, NAME => 'testtb-testEmptyExportFileSystemState,,1696546888374.3c4ed734c8e38074dda99a71c02dc361.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6ab3bee7fcad8ee75f4d22fdc3d658b4, NAME => 'testtb-testEmptyExportFileSystemState,1,1696546888374.6ab3bee7fcad8ee75f4d22fdc3d658b4.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:01:39,718 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 23:01:39,718 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546899718"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:39,720 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 23:01:39,721 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 23:01:39,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-10-05 23:01:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 23:01:39,799 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 23:01:39,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 23:01:39,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:39,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 23:01:39,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 23:01:39,834 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_309279073_1 at /127.0.0.1:36244 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4612 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:35393 from appattempt_1696546806436_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_309279073_1 at /127.0.0.1:51964 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:36274 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:56568 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_332825576_17 at /127.0.0.1:57588 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:46367 from appattempt_1696546806436_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x22b6e940-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:36845 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=927 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5681 (was 5763) 2023-10-05 23:01:39,834 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 23:01:39,852 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=168, AvailableMemoryMB=5681 2023-10-05 23:01:39,853 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 23:01:39,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 23:01:39,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:39,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 23:01:39,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 23:01:39,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 23:01:39,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 23:01:39,860 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:39,860 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:39,861 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f empty. 2023-10-05 23:01:39,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 empty. 2023-10-05 23:01:39,861 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:39,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:39,861 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 23:01:39,876 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 23:01:39,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => bd9fec9c983e01c83ad0a51bd0190fe8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:39,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a174c0fd9b2500ca0b9d843b8700511f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing bd9fec9c983e01c83ad0a51bd0190fe8, disabling compactions & flushes 2023-10-05 23:01:39,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. after waiting 0 ms 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:39,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for bd9fec9c983e01c83ad0a51bd0190fe8: 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:39,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a174c0fd9b2500ca0b9d843b8700511f, disabling compactions & flushes 2023-10-05 23:01:39,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:39,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:39,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. after waiting 0 ms 2023-10-05 23:01:39,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:39,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:39,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a174c0fd9b2500ca0b9d843b8700511f: 2023-10-05 23:01:39,901 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 23:01:39,902 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546899902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546899902"}]},"ts":"1696546899902"} 2023-10-05 23:01:39,902 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546899902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546899902"}]},"ts":"1696546899902"} 2023-10-05 23:01:39,904 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 23:01:39,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 23:01:39,905 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546899905"}]},"ts":"1696546899905"} 2023-10-05 23:01:39,906 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 23:01:39,910 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 23:01:39,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 23:01:39,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 23:01:39,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 23:01:39,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 23:01:39,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, ASSIGN}] 2023-10-05 23:01:39,914 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, ASSIGN 2023-10-05 23:01:39,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, ASSIGN 2023-10-05 23:01:39,915 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37651,1696546799838; forceNewPlan=false, retain=false 2023-10-05 23:01:39,915 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43513,1696546799925; forceNewPlan=false, retain=false 2023-10-05 23:01:39,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 23:01:40,065 INFO [jenkins-hbase4:41663] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 23:01:40,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a174c0fd9b2500ca0b9d843b8700511f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bd9fec9c983e01c83ad0a51bd0190fe8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546900068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546900068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546900068"}]},"ts":"1696546900068"} 2023-10-05 23:01:40,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546900068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546900068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546900068"}]},"ts":"1696546900068"} 2023-10-05 23:01:40,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure a174c0fd9b2500ca0b9d843b8700511f, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:40,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure bd9fec9c983e01c83ad0a51bd0190fe8, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:40,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 23:01:40,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a174c0fd9b2500ca0b9d843b8700511f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. service=AccessControlService 2023-10-05 23:01:40,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd9fec9c983e01c83ad0a51bd0190fe8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. service=AccessControlService 2023-10-05 23:01:40,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 23:01:40,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 23:01:40,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,226 INFO [StoreOpener-a174c0fd9b2500ca0b9d843b8700511f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,227 INFO [StoreOpener-bd9fec9c983e01c83ad0a51bd0190fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,227 DEBUG [StoreOpener-a174c0fd9b2500ca0b9d843b8700511f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf 2023-10-05 23:01:40,227 DEBUG [StoreOpener-a174c0fd9b2500ca0b9d843b8700511f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf 2023-10-05 23:01:40,228 DEBUG [StoreOpener-bd9fec9c983e01c83ad0a51bd0190fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf 2023-10-05 23:01:40,228 DEBUG [StoreOpener-bd9fec9c983e01c83ad0a51bd0190fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf 2023-10-05 23:01:40,228 INFO [StoreOpener-a174c0fd9b2500ca0b9d843b8700511f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a174c0fd9b2500ca0b9d843b8700511f columnFamilyName cf 2023-10-05 23:01:40,228 INFO [StoreOpener-bd9fec9c983e01c83ad0a51bd0190fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd9fec9c983e01c83ad0a51bd0190fe8 columnFamilyName cf 2023-10-05 23:01:40,229 INFO [StoreOpener-a174c0fd9b2500ca0b9d843b8700511f-1] regionserver.HStore(310): Store=a174c0fd9b2500ca0b9d843b8700511f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:40,229 INFO [StoreOpener-bd9fec9c983e01c83ad0a51bd0190fe8-1] regionserver.HStore(310): Store=bd9fec9c983e01c83ad0a51bd0190fe8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 23:01:40,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:40,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:40,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:40,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 23:01:40,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd9fec9c983e01c83ad0a51bd0190fe8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60373511, jitterRate=-0.1003645807504654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:40,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a174c0fd9b2500ca0b9d843b8700511f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65856633, jitterRate=-0.018659695982933044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 23:01:40,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd9fec9c983e01c83ad0a51bd0190fe8: 2023-10-05 23:01:40,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a174c0fd9b2500ca0b9d843b8700511f: 2023-10-05 23:01:40,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8., pid=109, masterSystemTime=1696546900222 2023-10-05 23:01:40,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f., pid=108, masterSystemTime=1696546900221 2023-10-05 23:01:40,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,238 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bd9fec9c983e01c83ad0a51bd0190fe8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,238 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546900238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546900238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546900238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546900238"}]},"ts":"1696546900238"} 2023-10-05 23:01:40,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,238 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a174c0fd9b2500ca0b9d843b8700511f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,238 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546900238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696546900238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696546900238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696546900238"}]},"ts":"1696546900238"} 2023-10-05 23:01:40,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-05 23:01:40,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure bd9fec9c983e01c83ad0a51bd0190fe8, server=jenkins-hbase4.apache.org,37651,1696546799838 in 169 msec 2023-10-05 23:01:40,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-05 23:01:40,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure a174c0fd9b2500ca0b9d843b8700511f, server=jenkins-hbase4.apache.org,43513,1696546799925 in 170 msec 2023-10-05 23:01:40,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, ASSIGN in 330 msec 2023-10-05 23:01:40,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-05 23:01:40,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, ASSIGN in 331 msec 2023-10-05 23:01:40,243 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 23:01:40,244 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546900244"}]},"ts":"1696546900244"} 2023-10-05 23:01:40,245 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 23:01:40,246 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 23:01:40,247 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 23:01:40,248 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 23:01:40,249 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:40,249 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:40,249 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:40,249 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:40,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:40,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:40,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:40,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 23:01:40,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 397 msec 2023-10-05 23:01:40,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 23:01:40,462 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 23:01:40,463 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,465 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:40,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546900475 (current time:1696546900475). 2023-10-05 23:01:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x77142e0d to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:40,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1979e610, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:40,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,491 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77142e0d to 127.0.0.1:64387 2023-10-05 23:01:40,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:40,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x61b41dfe to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37863383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:40,498 DEBUG [hconnection-0x61191a05-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,501 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,506 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61b41dfe to 127.0.0.1:64387 2023-10-05 23:01:40,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:40,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 23:01:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,510 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:40,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,512 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,512 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696547500512 2023-10-05 23:01:40,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,514 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:40,514 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:40,515 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:40,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-05 23:01:40,516 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:40,517 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696547500517 2023-10-05 23:01:40,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,525 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 23:01:40,525 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,526 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 23:01:40,526 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 23:01:40,527 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,527 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,530 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,530 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,530 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,530 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,530 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,531 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 23:01:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,531 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 23:01:40,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,533 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,535 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,535 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,535 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,535 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,544 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,544 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,545 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,545 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a257153[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 23:01:40,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a257153[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:40,548 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 23:01:40,548 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:40,551 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:40,552 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. started... 2023-10-05 23:01:40,551 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,551 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,552 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:40,552 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:40,552 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd9fec9c983e01c83ad0a51bd0190fe8: 2023-10-05 23:01:40,552 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. started... 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a174c0fd9b2500ca0b9d843b8700511f: 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:40,554 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 23:01:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,569 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. completed. 2023-10-05 23:01:40,569 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,569 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:40,571 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. completed. 2023-10-05 23:01:40,571 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,571 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,572 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,572 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,574 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,576 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:40,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 23:01:40,582 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 23:01:40,582 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:40,582 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:40,582 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,582 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,584 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,585 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,585 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,586 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,587 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,588 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,588 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,592 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,592 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,594 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,596 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 23:01:40,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,614 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:40,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 23:01:40,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:01:40,615 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:01:40,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 23:01:40,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,623 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696546900513Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696546900604 (+91 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696546900604Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696546900604Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696546900607 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696546900615 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696546900622 (+7 ms) 2023-10-05 23:01:40,625 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:40,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 112 msec 2023-10-05 23:01:40,815 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 23:01:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:40,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37651] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:40,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 23:01:40,821 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,821 DEBUG [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,822 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 23:01:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696546900830 (current time:1696546900830). 2023-10-05 23:01:40,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 23:01:40,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x311f9fe7 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:40,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7910dc8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:40,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,840 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x311f9fe7 to 127.0.0.1:64387 2023-10-05 23:01:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:40,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(139): Connect 0x5743a7d4 to 127.0.0.1:64387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 23:01:40,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aeeea7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 23:01:40,847 DEBUG [hconnection-0x65e5b103-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,848 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 23:01:40,853 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 23:01:40,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5743a7d4 to 127.0.0.1:64387 2023-10-05 23:01:40,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:01:40,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 23:01:40,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 23:01:40,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,857 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot, current working dir path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 23:01:40,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,859 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,860 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696547500860 2023-10-05 23:01:40,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 23:01:40,861 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 23:01:40,861 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 23:01:40,862 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 23:01:40,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:40,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 23:01:40,864 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:40,864 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696547500864 2023-10-05 23:01:40,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,875 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 23:01:40,875 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,876 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 23:01:40,876 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 23:01:40,876 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,876 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,878 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,878 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,878 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,878 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,879 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,879 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,879 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,879 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 23:01:40,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 23:01:40,880 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,880 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,881 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,881 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 23:01:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,881 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1696546799886' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,882 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 23:01:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 23:01:40,884 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 23:01:40,884 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 23:01:40,885 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,885 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,886 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,886 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 23:01:40,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43513,1696546799925' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a2c71bd[Count = 1] remaining members to acquire global barrier 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37651,1696546799838' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 23:01:40,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a2c71bd[Count = 0] remaining members to acquire global barrier 2023-10-05 23:01:40,890 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 23:01:40,890 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:40,895 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,895 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. started... 2023-10-05 23:01:40,895 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,895 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 23:01:40,895 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bd9fec9c983e01c83ad0a51bd0190fe8 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 23:01:40,896 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 23:01:40,895 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46597,1696546799886' in zk 2023-10-05 23:01:40,896 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,896 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. started... 2023-10-05 23:01:40,896 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a174c0fd9b2500ca0b9d843b8700511f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 23:01:40,897 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,897 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,897 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1696546799886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,920 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104 2023-10-05 23:01:40,921 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7 2023-10-05 23:01:40,927 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/.tmp/cf/3474e67195e949afbc0ec61b7ca872e1 2023-10-05 23:01:40,928 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/.tmp/cf/2851f81ef7ca48abb3f4836dcef83cf7 2023-10-05 23:01:40,931 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/.tmp/cf/3474e67195e949afbc0ec61b7ca872e1 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1 2023-10-05 23:01:40,932 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/.tmp/cf/2851f81ef7ca48abb3f4836dcef83cf7 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7 2023-10-05 23:01:40,936 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1, entries=5, sequenceid=6, filesize=5.8 K 2023-10-05 23:01:40,936 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7, entries=45, sequenceid=6, filesize=13.0 K 2023-10-05 23:01:40,936 INFO [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for bd9fec9c983e01c83ad0a51bd0190fe8 in 41ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:40,936 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 23:01:40,937 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd9fec9c983e01c83ad0a51bd0190fe8: 2023-10-05 23:01:40,937 INFO [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a174c0fd9b2500ca0b9d843b8700511f in 41ms, sequenceid=6, compaction requested=false 2023-10-05 23:01:40,937 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a174c0fd9b2500ca0b9d843b8700511f: 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1] hfiles 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7] hfiles 2023-10-05 23:01:40,939 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,950 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. completed. 2023-10-05 23:01:40,950 DEBUG [rs(jenkins-hbase4.apache.org,43513,1696546799925)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43513,1696546799925' in zk 2023-10-05 23:01:40,950 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. completed. 2023-10-05 23:01:40,950 DEBUG [rs(jenkins-hbase4.apache.org,37651,1696546799838)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 23:01:40,950 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37651,1696546799838' in zk 2023-10-05 23:01:40,952 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,43513,1696546799925' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,954 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,954 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 23:01:40,954 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,954 DEBUG [member: 'jenkins-hbase4.apache.org,37651,1696546799838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 23:01:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43513,1696546799925': 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43513,1696546799925' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37651,1696546799838': 2023-10-05 23:01:40,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37651,1696546799838' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 23:01:40,960 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 23:01:40,960 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 23:01:40,960 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 23:01:40,960 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,960 INFO [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 23:01:40,961 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,961 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,962 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,961 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,962 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 23:01:40,962 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,962 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,963 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 23:01:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 23:01:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 23:01:40,964 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 23:01:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,965 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 23:01:40,965 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,965 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 23:01:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 23:01:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 23:01:40,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,968 DEBUG [(jenkins-hbase4.apache.org,41663,1696546798610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 23:01:40,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,968 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 23:01:40,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,970 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104] mob files 2023-10-05 23:01:40,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7 2023-10-05 23:01:40,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104 2023-10-05 23:01:40,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 23:01:40,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,999 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:40,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696546900860Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696546900977 (+117 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696546900977Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696546900977Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696546900980 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696546900991 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696546900998 (+7 ms) 2023-10-05 23:01:41,002 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 23:01:41,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 141 msec 2023-10-05 23:01:41,164 DEBUG [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 23:01:41,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 23:01:41,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 23:01:41,165 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165 2023-10-05 23:01:41,165 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44933, tgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165, rawTgtDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165, srcFsUri=hdfs://localhost:44933, srcDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:41,186 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd 2023-10-05 23:01:41,187 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1322244387_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:41,187 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44933, inputRoot=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd, snapshotDir=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 23:01:41,195 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:41,212 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:41,212 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:41,213 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:41,213 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-9190036590879521573.jar 2023-10-05 23:01:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,082 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,148 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/hadoop-366219624145487692.jar 2023-10-05 23:01:42,148 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,148 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,149 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,149 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,150 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,150 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 23:01:42,150 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 23:01:42,151 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 23:01:42,151 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 23:01:42,151 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 23:01:42,152 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 23:01:42,152 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 23:01:42,152 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 23:01:42,153 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 23:01:42,153 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 23:01:42,153 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 23:01:42,154 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:42,154 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:42,155 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:42,155 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:42,155 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 23:01:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/41245] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 23:01:42,506 WARN [Listener at jenkins-hbase4.apache.org/41245] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 23:01:42,508 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 23:01:42,510 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 23:01:43,821 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:43,821 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 23:01:43,823 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0006_000001 (auth:SIMPLE) 2023-10-05 23:01:44,263 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0007_000001 (auth:SIMPLE) 2023-10-05 23:01:45,135 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:01:48,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0007_000001 (auth:SIMPLE) 2023-10-05 23:01:50,222 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0007_000001 (auth:SIMPLE) 2023-10-05 23:01:52,762 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0007_000001 (auth:SIMPLE) 2023-10-05 23:01:54,680 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 23:01:54,680 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 23:01:54,691 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,691 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 23:01:54,691 INFO [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 23:01:54,691 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 23:01:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 23:01:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_332825576_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 23:01:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/41245] snapshot.TestExportSnapshot(367): hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/export-test/export-1696546901165/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 23:01:54,698 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:54,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 23:01:54,702 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546914702"}]},"ts":"1696546914702"} 2023-10-05 23:01:54,703 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 23:01:54,704 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 23:01:54,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, UNASSIGN}] 2023-10-05 23:01:54,707 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, UNASSIGN 2023-10-05 23:01:54,707 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, UNASSIGN 2023-10-05 23:01:54,707 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bd9fec9c983e01c83ad0a51bd0190fe8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:01:54,707 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a174c0fd9b2500ca0b9d843b8700511f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:01:54,707 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546914707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546914707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546914707"}]},"ts":"1696546914707"} 2023-10-05 23:01:54,707 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546914707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696546914707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696546914707"}]},"ts":"1696546914707"} 2023-10-05 23:01:54,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure bd9fec9c983e01c83ad0a51bd0190fe8, server=jenkins-hbase4.apache.org,37651,1696546799838}] 2023-10-05 23:01:54,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a174c0fd9b2500ca0b9d843b8700511f, server=jenkins-hbase4.apache.org,43513,1696546799925}] 2023-10-05 23:01:54,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 23:01:54,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:54,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:54,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd9fec9c983e01c83ad0a51bd0190fe8, disabling compactions & flushes 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a174c0fd9b2500ca0b9d843b8700511f, disabling compactions & flushes 2023-10-05 23:01:54,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:54,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. after waiting 0 ms 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. after waiting 0 ms 2023-10-05 23:01:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:01:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:54,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:01:54,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8. 2023-10-05 23:01:54,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd9fec9c983e01c83ad0a51bd0190fe8: 2023-10-05 23:01:54,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f. 2023-10-05 23:01:54,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a174c0fd9b2500ca0b9d843b8700511f: 2023-10-05 23:01:54,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:54,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bd9fec9c983e01c83ad0a51bd0190fe8, regionState=CLOSED 2023-10-05 23:01:54,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546914875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546914875"}]},"ts":"1696546914875"} 2023-10-05 23:01:54,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:54,875 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a174c0fd9b2500ca0b9d843b8700511f, regionState=CLOSED 2023-10-05 23:01:54,875 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696546914875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696546914875"}]},"ts":"1696546914875"} 2023-10-05 23:01:54,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 23:01:54,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure bd9fec9c983e01c83ad0a51bd0190fe8, server=jenkins-hbase4.apache.org,37651,1696546799838 in 168 msec 2023-10-05 23:01:54,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 23:01:54,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure a174c0fd9b2500ca0b9d843b8700511f, server=jenkins-hbase4.apache.org,43513,1696546799925 in 168 msec 2023-10-05 23:01:54,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bd9fec9c983e01c83ad0a51bd0190fe8, UNASSIGN in 173 msec 2023-10-05 23:01:54,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-05 23:01:54,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a174c0fd9b2500ca0b9d843b8700511f, UNASSIGN in 173 msec 2023-10-05 23:01:54,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696546914881"}]},"ts":"1696546914881"} 2023-10-05 23:01:54,882 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 23:01:54,884 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 23:01:54,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-10-05 23:01:55,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 23:01:55,004 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 23:01:55,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,007 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,008 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,009 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37651] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,013 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,013 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:55,013 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,013 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,013 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:55,013 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,014 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 23:01:55,014 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 23:01:55,015 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,015 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:55,015 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:55,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-05 23:01:55,015 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:01:55,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-05 23:01:55,015 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,015 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:55,015 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 23:01:55,015 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/recovered.edits] 2023-10-05 23:01:55,015 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf, FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/recovered.edits] 2023-10-05 23:01:55,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 23:01:55,016 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 23:01:55,020 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/cf/2851f81ef7ca48abb3f4836dcef83cf7 2023-10-05 23:01:55,020 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/cf/3474e67195e949afbc0ec61b7ca872e1 2023-10-05 23:01:55,023 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f/recovered.edits/9.seqid 2023-10-05 23:01:55,023 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/recovered.edits/9.seqid to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8/recovered.edits/9.seqid 2023-10-05 23:01:55,024 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a174c0fd9b2500ca0b9d843b8700511f 2023-10-05 23:01:55,024 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bd9fec9c983e01c83ad0a51bd0190fe8 2023-10-05 23:01:55,024 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 23:01:55,024 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 23:01:55,025 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 23:01:55,028 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310050c538da039374b2c860caac9164872e7 2023-10-05 23:01:55,030 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104 to hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100580b49348613242578d2c88ef88d9c104 2023-10-05 23:01:55,030 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 23:01:55,032 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,034 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 23:01:55,036 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 23:01:55,037 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,037 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 23:01:55,037 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546915037"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:55,037 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696546915037"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:55,039 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 23:01:55,039 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bd9fec9c983e01c83ad0a51bd0190fe8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696546899854.bd9fec9c983e01c83ad0a51bd0190fe8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a174c0fd9b2500ca0b9d843b8700511f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696546899854.a174c0fd9b2500ca0b9d843b8700511f.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 23:01:55,039 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 23:01:55,039 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696546915039"}]},"ts":"9223372036854775807"} 2023-10-05 23:01:55,041 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 23:01:55,043 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-10-05 23:01:55,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 23:01:55,117 INFO [Listener at jenkins-hbase4.apache.org/41245] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 23:01:55,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 23:01:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 23:01:55,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41663] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 23:01:55,151 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 765), OpenFileDescriptor=905 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 229) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5610 (was 5681) 2023-10-05 23:01:55,151 WARN [Listener at jenkins-hbase4.apache.org/41245] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-05 23:01:55,151 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 23:01:55,161 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 23:01:58,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696546806436_0007_000001 (auth:SIMPLE) 2023-10-05 23:02:00,439 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 23:02:09,281 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 23:02:23,393 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 23:02:23,394 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 23:02:23,500 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 23:02:23,505 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 23:02:23,507 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 23:02:23,512 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 23:02:23,616 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 23:02:23,616 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 23:02:23,617 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 23:02:23,617 INFO [Listener at jenkins-hbase4.apache.org/41245] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 23:02:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/41245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35229d65 to 127.0.0.1:64387 2023-10-05 23:02:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/41245] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 23:02:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/41245] util.JVMClusterUtil(257): Found active master hash=1597975956, stopped=false 2023-10-05 23:02:23,617 DEBUG [Listener at jenkins-hbase4.apache.org/41245] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,618 DEBUG [Listener at jenkins-hbase4.apache.org/41245] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 23:02:23,618 INFO [Listener at jenkins-hbase4.apache.org/41245] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:02:23,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 23:02:23,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 23:02:23,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:02:23,619 INFO [Listener at jenkins-hbase4.apache.org/41245] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 23:02:23,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 23:02:23,619 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 23:02:23,619 DEBUG [Listener at jenkins-hbase4.apache.org/41245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f0bceda to 127.0.0.1:64387 2023-10-05 23:02:23,620 DEBUG [Listener at jenkins-hbase4.apache.org/41245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 23:02:23,620 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37651,1696546799838' ***** 2023-10-05 23:02:23,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 23:02:23,620 DEBUG [Listener at jenkins-hbase4.apache.org/41245] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,620 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 23:02:23,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 23:02:23,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 23:02:23,620 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46597,1696546799886' ***** 2023-10-05 23:02:23,620 INFO [RS:0;jenkins-hbase4:37651] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 23:02:23,620 DEBUG [Listener at jenkins-hbase4.apache.org/41245] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,621 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 23:02:23,621 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43513,1696546799925' ***** 2023-10-05 23:02:23,621 INFO [RS:0;jenkins-hbase4:37651] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 23:02:23,621 INFO [RS:1;jenkins-hbase4:46597] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 23:02:23,621 INFO [RS:0;jenkins-hbase4:37651] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 23:02:23,621 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 23:02:23,621 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 23:02:23,621 DEBUG [Listener at jenkins-hbase4.apache.org/41245] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,621 INFO [RS:1;jenkins-hbase4:46597] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 23:02:23,621 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(3305): Received CLOSE for bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:02:23,621 INFO [Listener at jenkins-hbase4.apache.org/41245] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 23:02:23,621 INFO [RS:1;jenkins-hbase4:46597] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 23:02:23,621 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:02:23,621 INFO [RS:2;jenkins-hbase4:43513] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 23:02:23,621 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:02:23,621 INFO [RS:2;jenkins-hbase4:43513] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 23:02:23,621 DEBUG [RS:0;jenkins-hbase4:37651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fa714db to 127.0.0.1:64387 2023-10-05 23:02:23,621 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a6ef4b7 to 127.0.0.1:64387 2023-10-05 23:02:23,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf1ba7f11401a438c3aac77c40b81ede, disabling compactions & flushes 2023-10-05 23:02:23,622 DEBUG [RS:0;jenkins-hbase4:37651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,621 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 23:02:23,621 INFO [RS:2;jenkins-hbase4:43513] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 23:02:23,623 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 23:02:23,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:02:23,622 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:02:23,623 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(3305): Received CLOSE for d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:02:23,623 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1478): Online Regions={bf1ba7f11401a438c3aac77c40b81ede=hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede.} 2023-10-05 23:02:23,625 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:02:23,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. after waiting 0 ms 2023-10-05 23:02:23,625 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46597,1696546799886; all regions closed. 2023-10-05 23:02:23,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:02:23,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6b4667647a5d88298b34a89f1bcd9a9, disabling compactions & flushes 2023-10-05 23:02:23,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bf1ba7f11401a438c3aac77c40b81ede 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 23:02:23,625 DEBUG [RS:2;jenkins-hbase4:43513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54aba08c to 127.0.0.1:64387 2023-10-05 23:02:23,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:02:23,626 DEBUG [RS:2;jenkins-hbase4:43513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:02:23,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. after waiting 0 ms 2023-10-05 23:02:23,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:02:23,627 INFO [RS:2;jenkins-hbase4:43513] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 23:02:23,627 INFO [RS:2;jenkins-hbase4:43513] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 23:02:23,627 INFO [RS:2;jenkins-hbase4:43513] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 23:02:23,627 DEBUG [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1504): Waiting on bf1ba7f11401a438c3aac77c40b81ede 2023-10-05 23:02:23,627 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 23:02:23,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d6b4667647a5d88298b34a89f1bcd9a9 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 23:02:23,627 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-05 23:02:23,627 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1478): Online Regions={d6b4667647a5d88298b34a89f1bcd9a9=hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9., 1588230740=hbase:meta,,1.1588230740} 2023-10-05 23:02:23,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 23:02:23,628 DEBUG [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1504): Waiting on 1588230740, d6b4667647a5d88298b34a89f1bcd9a9 2023-10-05 23:02:23,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 23:02:23,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 23:02:23,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 23:02:23,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 23:02:23,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 23:02:23,630 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,630 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,633 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,640 DEBUG [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs 2023-10-05 23:02:23,641 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46597%2C1696546799886:(num 1696546801600) 2023-10-05 23:02:23,641 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,641 INFO [RS:1;jenkins-hbase4:46597] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,641 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 23:02:23,641 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 23:02:23,641 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 23:02:23,641 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 23:02:23,642 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 23:02:23,647 INFO [RS:1;jenkins-hbase4:46597] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46597 2023-10-05 23:02:23,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/.tmp/info/0115cc64b5194d12b400ceb6f7bc1448 2023-10-05 23:02:23,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/info/21e98f2b3add4799b519cc88809c8012 2023-10-05 23:02:23,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/.tmp/l/1aef1413ccf6401a98b4ac432410e84f 2023-10-05 23:02:23,653 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:02:23,653 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,654 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:02:23,654 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,653 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46597,1696546799886 2023-10-05 23:02:23,654 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,653 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,654 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46597,1696546799886] 2023-10-05 23:02:23,655 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46597,1696546799886; numProcessing=1 2023-10-05 23:02:23,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/.tmp/info/0115cc64b5194d12b400ceb6f7bc1448 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/info/0115cc64b5194d12b400ceb6f7bc1448 2023-10-05 23:02:23,657 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46597,1696546799886 already deleted, retry=false 2023-10-05 23:02:23,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21e98f2b3add4799b519cc88809c8012 2023-10-05 23:02:23,657 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46597,1696546799886 expired; onlineServers=2 2023-10-05 23:02:23,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1aef1413ccf6401a98b4ac432410e84f 2023-10-05 23:02:23,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/.tmp/l/1aef1413ccf6401a98b4ac432410e84f as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/l/1aef1413ccf6401a98b4ac432410e84f 2023-10-05 23:02:23,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/info/0115cc64b5194d12b400ceb6f7bc1448, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 23:02:23,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d6b4667647a5d88298b34a89f1bcd9a9 in 38ms, sequenceid=6, compaction requested=false 2023-10-05 23:02:23,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1aef1413ccf6401a98b4ac432410e84f 2023-10-05 23:02:23,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/l/1aef1413ccf6401a98b4ac432410e84f, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 23:02:23,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for bf1ba7f11401a438c3aac77c40b81ede in 42ms, sequenceid=18, compaction requested=false 2023-10-05 23:02:23,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/rep_barrier/92819102f9434fb0a55e407abe2ffcb7 2023-10-05 23:02:23,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/namespace/d6b4667647a5d88298b34a89f1bcd9a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 23:02:23,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/acl/bf1ba7f11401a438c3aac77c40b81ede/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 23:02:23,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:02:23,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6b4667647a5d88298b34a89f1bcd9a9: 2023-10-05 23:02:23,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696546802055.d6b4667647a5d88298b34a89f1bcd9a9. 2023-10-05 23:02:23,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:02:23,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf1ba7f11401a438c3aac77c40b81ede: 2023-10-05 23:02:23,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696546802794.bf1ba7f11401a438c3aac77c40b81ede. 2023-10-05 23:02:23,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92819102f9434fb0a55e407abe2ffcb7 2023-10-05 23:02:23,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/table/a3005e32834645d58a4f7be7fb6f5e20 2023-10-05 23:02:23,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3005e32834645d58a4f7be7fb6f5e20 2023-10-05 23:02:23,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/info/21e98f2b3add4799b519cc88809c8012 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/info/21e98f2b3add4799b519cc88809c8012 2023-10-05 23:02:23,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21e98f2b3add4799b519cc88809c8012 2023-10-05 23:02:23,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/info/21e98f2b3add4799b519cc88809c8012, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 23:02:23,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/rep_barrier/92819102f9434fb0a55e407abe2ffcb7 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/rep_barrier/92819102f9434fb0a55e407abe2ffcb7 2023-10-05 23:02:23,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92819102f9434fb0a55e407abe2ffcb7 2023-10-05 23:02:23,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/rep_barrier/92819102f9434fb0a55e407abe2ffcb7, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 23:02:23,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/.tmp/table/a3005e32834645d58a4f7be7fb6f5e20 as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/table/a3005e32834645d58a4f7be7fb6f5e20 2023-10-05 23:02:23,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3005e32834645d58a4f7be7fb6f5e20 2023-10-05 23:02:23,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/table/a3005e32834645d58a4f7be7fb6f5e20, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 23:02:23,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 103ms, sequenceid=131, compaction requested=false 2023-10-05 23:02:23,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 23:02:23,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 23:02:23,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 23:02:23,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 23:02:23,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 23:02:23,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 23:02:23,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:23,755 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46597,1696546799886; zookeeper connection closed. 2023-10-05 23:02:23,755 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x10118d0f0190002, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:23,756 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d0acda8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d0acda8 2023-10-05 23:02:23,827 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37651,1696546799838; all regions closed. 2023-10-05 23:02:23,828 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43513,1696546799925; all regions closed. 2023-10-05 23:02:23,834 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/WALs/jenkins-hbase4.apache.org,43513,1696546799925/jenkins-hbase4.apache.org%2C43513%2C1696546799925.meta.1696546801712.meta not finished, retry = 0 2023-10-05 23:02:23,835 DEBUG [RS:0;jenkins-hbase4:37651] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs 2023-10-05 23:02:23,835 INFO [RS:0;jenkins-hbase4:37651] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37651%2C1696546799838:(num 1696546801600) 2023-10-05 23:02:23,835 DEBUG [RS:0;jenkins-hbase4:37651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,835 INFO [RS:0;jenkins-hbase4:37651] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,836 INFO [RS:0;jenkins-hbase4:37651] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 23:02:23,836 INFO [RS:0;jenkins-hbase4:37651] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 23:02:23,836 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 23:02:23,836 INFO [RS:0;jenkins-hbase4:37651] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 23:02:23,836 INFO [RS:0;jenkins-hbase4:37651] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 23:02:23,837 INFO [RS:0;jenkins-hbase4:37651] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37651 2023-10-05 23:02:23,839 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:02:23,839 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37651,1696546799838 2023-10-05 23:02:23,839 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,840 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37651,1696546799838] 2023-10-05 23:02:23,840 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37651,1696546799838; numProcessing=2 2023-10-05 23:02:23,841 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37651,1696546799838 already deleted, retry=false 2023-10-05 23:02:23,841 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37651,1696546799838 expired; onlineServers=1 2023-10-05 23:02:23,937 DEBUG [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs 2023-10-05 23:02:23,937 INFO [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43513%2C1696546799925.meta:.meta(num 1696546801712) 2023-10-05 23:02:23,940 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:23,940 INFO [RS:0;jenkins-hbase4:37651] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37651,1696546799838; zookeeper connection closed. 2023-10-05 23:02:23,940 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:37651-0x10118d0f0190001, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:23,940 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@28f4d505] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@28f4d505 2023-10-05 23:02:23,946 DEBUG [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/oldWALs 2023-10-05 23:02:23,946 INFO [RS:2;jenkins-hbase4:43513] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43513%2C1696546799925:(num 1696546801599) 2023-10-05 23:02:23,946 DEBUG [RS:2;jenkins-hbase4:43513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,947 INFO [RS:2;jenkins-hbase4:43513] regionserver.LeaseManager(133): Closed leases 2023-10-05 23:02:23,947 INFO [RS:2;jenkins-hbase4:43513] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 23:02:23,947 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 23:02:23,948 INFO [RS:2;jenkins-hbase4:43513] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43513 2023-10-05 23:02:23,950 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43513,1696546799925 2023-10-05 23:02:23,950 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 23:02:23,952 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43513,1696546799925] 2023-10-05 23:02:23,952 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43513,1696546799925; numProcessing=3 2023-10-05 23:02:23,953 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43513,1696546799925 already deleted, retry=false 2023-10-05 23:02:23,953 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43513,1696546799925 expired; onlineServers=0 2023-10-05 23:02:23,953 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41663,1696546798610' ***** 2023-10-05 23:02:23,953 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 23:02:23,953 DEBUG [M:0;jenkins-hbase4:41663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e0227af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 23:02:23,953 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41663,1696546798610 2023-10-05 23:02:23,953 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41663,1696546798610; all regions closed. 2023-10-05 23:02:23,953 DEBUG [M:0;jenkins-hbase4:41663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 23:02:23,953 DEBUG [M:0;jenkins-hbase4:41663] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 23:02:23,953 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 23:02:23,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696546801163] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696546801163,5,FailOnTimeoutGroup] 2023-10-05 23:02:23,954 DEBUG [M:0;jenkins-hbase4:41663] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 23:02:23,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696546801163] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696546801163,5,FailOnTimeoutGroup] 2023-10-05 23:02:23,954 INFO [M:0;jenkins-hbase4:41663] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 23:02:23,954 INFO [M:0;jenkins-hbase4:41663] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 23:02:23,954 INFO [M:0;jenkins-hbase4:41663] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 23:02:23,954 DEBUG [M:0;jenkins-hbase4:41663] master.HMaster(1512): Stopping service threads 2023-10-05 23:02:23,954 INFO [M:0;jenkins-hbase4:41663] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 23:02:23,954 ERROR [M:0;jenkins-hbase4:41663] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-05 23:02:23,954 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-05 23:02:23,954 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 23:02:23,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 23:02:23,955 INFO [M:0;jenkins-hbase4:41663] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 23:02:23,955 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 23:02:23,955 DEBUG [M:0;jenkins-hbase4:41663] zookeeper.ZKUtil(398): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 23:02:23,955 WARN [M:0;jenkins-hbase4:41663] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 23:02:23,955 INFO [M:0;jenkins-hbase4:41663] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 23:02:23,956 INFO [M:0;jenkins-hbase4:41663] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 23:02:23,956 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 23:02:23,956 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:02:23,956 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:02:23,956 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 23:02:23,956 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:02:23,956 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.94 KB heapSize=452.17 KB 2023-10-05 23:02:23,976 INFO [M:0;jenkins-hbase4:41663] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.94 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6bb2efc8cdc0483b8d8abfa0c6c4198b 2023-10-05 23:02:23,979 INFO [M:0;jenkins-hbase4:41663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bb2efc8cdc0483b8d8abfa0c6c4198b 2023-10-05 23:02:23,980 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6bb2efc8cdc0483b8d8abfa0c6c4198b as hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6bb2efc8cdc0483b8d8abfa0c6c4198b 2023-10-05 23:02:23,984 INFO [M:0;jenkins-hbase4:41663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bb2efc8cdc0483b8d8abfa0c6c4198b 2023-10-05 23:02:23,984 INFO [M:0;jenkins-hbase4:41663] regionserver.HStore(1080): Added hdfs://localhost:44933/user/jenkins/test-data/0bfafa61-d27d-fd4b-15e7-5d878be0a0bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6bb2efc8cdc0483b8d8abfa0c6c4198b, entries=119, sequenceid=899, filesize=28.7 K 2023-10-05 23:02:23,985 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegion(2948): Finished flush of dataSize ~375.94 KB/384959, heapSize ~452.16 KB/463008, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-10-05 23:02:23,987 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 23:02:23,987 DEBUG [M:0;jenkins-hbase4:41663] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 23:02:23,990 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 23:02:23,990 INFO [M:0;jenkins-hbase4:41663] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 23:02:23,991 INFO [M:0;jenkins-hbase4:41663] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41663 2023-10-05 23:02:23,994 DEBUG [M:0;jenkins-hbase4:41663] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41663,1696546798610 already deleted, retry=false 2023-10-05 23:02:24,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:24,052 INFO [RS:2;jenkins-hbase4:43513] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43513,1696546799925; zookeeper connection closed. 2023-10-05 23:02:24,052 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): regionserver:43513-0x10118d0f0190003, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:24,052 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50b42db1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50b42db1 2023-10-05 23:02:24,052 INFO [Listener at jenkins-hbase4.apache.org/41245] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 23:02:24,152 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:24,152 INFO [M:0;jenkins-hbase4:41663] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41663,1696546798610; zookeeper connection closed. 2023-10-05 23:02:24,152 DEBUG [Listener at localhost/44633-EventThread] zookeeper.ZKWatcher(600): master:41663-0x10118d0f0190000, quorum=127.0.0.1:64387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 23:02:24,154 WARN [Listener at jenkins-hbase4.apache.org/41245] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 23:02:24,157 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 23:02:24,261 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 23:02:24,261 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-886418912-172.31.14.131-1696546794865 (Datanode Uuid 7f69eba1-2397-464d-b2eb-bc38257c61d8) service to localhost/127.0.0.1:44933 2023-10-05 23:02:24,263 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data5/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,263 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data6/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,265 WARN [Listener at jenkins-hbase4.apache.org/41245] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 23:02:24,267 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 23:02:24,369 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 23:02:24,369 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-886418912-172.31.14.131-1696546794865 (Datanode Uuid 447cd7e0-614b-4df4-9eaa-662b104f6c8f) service to localhost/127.0.0.1:44933 2023-10-05 23:02:24,370 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data3/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,370 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data4/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,372 WARN [Listener at jenkins-hbase4.apache.org/41245] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 23:02:24,374 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 23:02:24,476 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 23:02:24,476 WARN [BP-886418912-172.31.14.131-1696546794865 heartbeating to localhost/127.0.0.1:44933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-886418912-172.31.14.131-1696546794865 (Datanode Uuid ab406a2c-c95e-4d3d-86f8-8dfaeff7ab0d) service to localhost/127.0.0.1:44933 2023-10-05 23:02:24,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data1/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/07483d0d-5c96-a8b5-6a38-5237d834e46f/cluster_578c7553-3c2c-6315-948d-cffe788438e8/dfs/data/data2/current/BP-886418912-172.31.14.131-1696546794865] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 23:02:24,501 INFO [Listener at jenkins-hbase4.apache.org/41245] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 23:02:24,626 INFO [Listener at jenkins-hbase4.apache.org/41245] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 23:02:24,709 INFO [Listener at jenkins-hbase4.apache.org/41245] hbase.HBaseTestingUtility(1293): Minicluster is down