2023-07-14 11:12:15,198 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 11:12:15,450 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941 2023-07-14 11:12:15,450 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-14 11:12:15,450 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-14 11:12:15,489 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 11:12:15,732 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 11:12:15,733 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9, deleteOnExit=true 2023-07-14 11:12:15,733 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 11:12:15,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/test.cache.data in system properties and HBase conf 2023-07-14 11:12:15,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 11:12:15,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop.log.dir in system properties and HBase conf 2023-07-14 11:12:15,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 11:12:15,736 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 11:12:15,736 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 11:12:16,067 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 11:12:16,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:16,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:16,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 11:12:16,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:16,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 11:12:16,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 11:12:16,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:16,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:16,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 11:12:16,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/nfs.dump.dir in system properties and HBase conf 2023-07-14 11:12:16,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir in system properties and HBase conf 2023-07-14 11:12:16,078 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:16,078 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 11:12:16,078 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 11:12:16,702 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 11:12:16,706 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 11:12:16,973 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 11:12:17,146 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 11:12:17,167 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:17,202 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:17,232 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_localhost_41989_hdfs____.il4jqx/webapp 2023-07-14 11:12:17,383 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41989 2023-07-14 11:12:17,430 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 11:12:17,431 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 11:12:17,993 WARN [Listener at localhost/45973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:18,100 WARN [Listener at localhost/45973] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:18,126 WARN [Listener at localhost/45973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:18,134 INFO [Listener at localhost/45973] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:18,143 INFO [Listener at localhost/45973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_localhost_36859_datanode____.gy8zcw/webapp 2023-07-14 11:12:18,290 INFO [Listener at localhost/45973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36859 2023-07-14 11:12:18,817 WARN [Listener at localhost/41483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:18,879 WARN [Listener at localhost/41483] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:18,885 WARN [Listener at localhost/41483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:18,887 INFO [Listener at localhost/41483] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:18,898 INFO [Listener at localhost/41483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_localhost_46715_datanode____xcn5mo/webapp 2023-07-14 11:12:19,039 INFO [Listener at localhost/41483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46715 2023-07-14 11:12:19,053 WARN [Listener at localhost/37485] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:19,099 WARN [Listener at localhost/37485] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:19,105 WARN [Listener at localhost/37485] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:19,108 INFO [Listener at localhost/37485] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:19,146 INFO [Listener at localhost/37485] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_localhost_36617_datanode____.no0bnk/webapp 2023-07-14 11:12:19,297 INFO [Listener at localhost/37485] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36617 2023-07-14 11:12:19,335 WARN [Listener at localhost/43501] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:19,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56a92040565e6bf2: Processing first storage report for DS-f944175f-f679-482e-9ba7-7cfb16d8e898 from datanode 5ca3054f-4d85-4c9b-ba86-e9d2b0aea287 2023-07-14 11:12:19,573 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56a92040565e6bf2: from storage DS-f944175f-f679-482e-9ba7-7cfb16d8e898 node DatanodeRegistration(127.0.0.1:38703, datanodeUuid=5ca3054f-4d85-4c9b-ba86-e9d2b0aea287, infoPort=38043, infoSecurePort=0, ipcPort=43501, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53be9545026f4b1b: Processing first storage report for DS-681cbe91-453e-46ce-b379-3eac3176d42d from datanode 711b9635-a200-433a-ab86-bf2dd89d3d7a 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53be9545026f4b1b: from storage DS-681cbe91-453e-46ce-b379-3eac3176d42d node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=711b9635-a200-433a-ab86-bf2dd89d3d7a, infoPort=42819, infoSecurePort=0, ipcPort=41483, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x188cc8b3f836092b: Processing first storage report for DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc from datanode f00d6b9d-33df-4ee5-9792-a22dd315775c 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x188cc8b3f836092b: from storage DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc node DatanodeRegistration(127.0.0.1:38529, datanodeUuid=f00d6b9d-33df-4ee5-9792-a22dd315775c, infoPort=36399, infoSecurePort=0, ipcPort=37485, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56a92040565e6bf2: Processing first storage report for DS-bc756e54-e2a4-4d1f-abea-d4359b7b52f0 from datanode 5ca3054f-4d85-4c9b-ba86-e9d2b0aea287 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56a92040565e6bf2: from storage DS-bc756e54-e2a4-4d1f-abea-d4359b7b52f0 node DatanodeRegistration(127.0.0.1:38703, datanodeUuid=5ca3054f-4d85-4c9b-ba86-e9d2b0aea287, infoPort=38043, infoSecurePort=0, ipcPort=43501, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53be9545026f4b1b: Processing first storage report for DS-95a64679-44de-4b99-9096-d0784e2d2586 from datanode 711b9635-a200-433a-ab86-bf2dd89d3d7a 2023-07-14 11:12:19,574 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53be9545026f4b1b: from storage DS-95a64679-44de-4b99-9096-d0784e2d2586 node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=711b9635-a200-433a-ab86-bf2dd89d3d7a, infoPort=42819, infoSecurePort=0, ipcPort=41483, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,575 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x188cc8b3f836092b: Processing first storage report for DS-b694e871-31b3-4038-853d-b587186e382d from datanode f00d6b9d-33df-4ee5-9792-a22dd315775c 2023-07-14 11:12:19,575 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x188cc8b3f836092b: from storage DS-b694e871-31b3-4038-853d-b587186e382d node DatanodeRegistration(127.0.0.1:38529, datanodeUuid=f00d6b9d-33df-4ee5-9792-a22dd315775c, infoPort=36399, infoSecurePort=0, ipcPort=37485, storageInfo=lv=-57;cid=testClusterID;nsid=403912029;c=1689333136777), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,809 DEBUG [Listener at localhost/43501] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941 2023-07-14 11:12:19,930 INFO [Listener at localhost/43501] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/zookeeper_0, clientPort=51121, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 11:12:19,954 INFO [Listener at localhost/43501] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51121 2023-07-14 11:12:19,965 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:19,968 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:20,647 INFO [Listener at localhost/43501] util.FSUtils(471): Created version file at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 with version=8 2023-07-14 11:12:20,647 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/hbase-staging 2023-07-14 11:12:21,020 INFO [Listener at localhost/43501] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 11:12:21,703 INFO [Listener at localhost/43501] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:21,735 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,736 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,736 INFO [Listener at localhost/43501] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:21,736 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,737 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:21,926 INFO [Listener at localhost/43501] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,036 DEBUG [Listener at localhost/43501] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 11:12:22,153 INFO [Listener at localhost/43501] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34219 2023-07-14 11:12:22,175 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,178 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,206 INFO [Listener at localhost/43501] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34219 connecting to ZooKeeper ensemble=127.0.0.1:51121 2023-07-14 11:12:22,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:342190x0, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34219-0x101637acd630000 connected 2023-07-14 11:12:22,316 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,317 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,335 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,349 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34219 2023-07-14 11:12:22,352 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34219 2023-07-14 11:12:22,353 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34219 2023-07-14 11:12:22,357 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34219 2023-07-14 11:12:22,361 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34219 2023-07-14 11:12:22,370 INFO [Listener at localhost/43501] master.HMaster(444): hbase.rootdir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, hbase.cluster.distributed=false 2023-07-14 11:12:22,454 INFO [Listener at localhost/43501] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,455 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,455 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,455 INFO [Listener at localhost/43501] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,455 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,455 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,461 INFO [Listener at localhost/43501] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,468 INFO [Listener at localhost/43501] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33095 2023-07-14 11:12:22,472 INFO [Listener at localhost/43501] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,489 INFO [Listener at localhost/43501] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 11:12:22,491 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,495 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,505 INFO [Listener at localhost/43501] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33095 connecting to ZooKeeper ensemble=127.0.0.1:51121 2023-07-14 11:12:22,529 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:330950x0, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,530 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:330950x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,545 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33095-0x101637acd630001 connected 2023-07-14 11:12:22,547 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,555 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33095 2023-07-14 11:12:22,561 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33095 2023-07-14 11:12:22,563 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33095 2023-07-14 11:12:22,568 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33095 2023-07-14 11:12:22,570 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33095 2023-07-14 11:12:22,587 INFO [Listener at localhost/43501] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,587 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,588 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,588 INFO [Listener at localhost/43501] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,589 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,589 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,589 INFO [Listener at localhost/43501] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,595 INFO [Listener at localhost/43501] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45073 2023-07-14 11:12:22,596 INFO [Listener at localhost/43501] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,606 INFO [Listener at localhost/43501] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 11:12:22,607 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,610 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,612 INFO [Listener at localhost/43501] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45073 connecting to ZooKeeper ensemble=127.0.0.1:51121 2023-07-14 11:12:22,635 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:450730x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,637 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:450730x0, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,639 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:450730x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,640 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:450730x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45073-0x101637acd630002 connected 2023-07-14 11:12:22,646 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45073 2023-07-14 11:12:22,649 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45073 2023-07-14 11:12:22,651 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45073 2023-07-14 11:12:22,658 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45073 2023-07-14 11:12:22,659 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45073 2023-07-14 11:12:22,676 INFO [Listener at localhost/43501] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,676 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,677 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,677 INFO [Listener at localhost/43501] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,677 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,677 INFO [Listener at localhost/43501] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,677 INFO [Listener at localhost/43501] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,687 INFO [Listener at localhost/43501] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45261 2023-07-14 11:12:22,688 INFO [Listener at localhost/43501] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,691 INFO [Listener at localhost/43501] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 11:12:22,692 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,695 INFO [Listener at localhost/43501] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,696 INFO [Listener at localhost/43501] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45261 connecting to ZooKeeper ensemble=127.0.0.1:51121 2023-07-14 11:12:22,722 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:452610x0, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,724 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:452610x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,726 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:452610x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,727 DEBUG [Listener at localhost/43501] zookeeper.ZKUtil(164): regionserver:452610x0, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45261-0x101637acd630003 connected 2023-07-14 11:12:22,742 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45261 2023-07-14 11:12:22,749 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45261 2023-07-14 11:12:22,765 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45261 2023-07-14 11:12:22,785 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45261 2023-07-14 11:12:22,789 DEBUG [Listener at localhost/43501] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45261 2023-07-14 11:12:22,795 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:22,808 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 11:12:22,812 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:22,840 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,840 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,841 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:22,842 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 11:12:22,843 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,34219,1689333140818 from backup master directory 2023-07-14 11:12:22,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 11:12:22,845 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,846 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,851 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:22,852 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 11:12:22,852 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:22,852 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:22,856 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 11:12:22,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 11:12:23,049 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/hbase.id with ID: 611b06e7-c578-40ce-a041-610931460f31 2023-07-14 11:12:23,101 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:23,117 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:23,202 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x200f6222 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:23,250 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25a4c45f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:23,295 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:23,299 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 11:12:23,326 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 11:12:23,326 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 11:12:23,328 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,334 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,336 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:23,406 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store-tmp 2023-07-14 11:12:23,509 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:23,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 11:12:23,510 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 11:12:23,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,510 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:12:23,512 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/WALs/jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:23,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34219%2C1689333140818, suffix=, logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/WALs/jenkins-hbase9.apache.org,34219,1689333140818, archiveDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/oldWALs, maxLogs=10 2023-07-14 11:12:23,743 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK] 2023-07-14 11:12:23,743 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK] 2023-07-14 11:12:23,743 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK] 2023-07-14 11:12:23,781 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,911 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/WALs/jenkins-hbase9.apache.org,34219,1689333140818/jenkins-hbase9.apache.org%2C34219%2C1689333140818.1689333143556 2023-07-14 11:12:23,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK], DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK]] 2023-07-14 11:12:23,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:23,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:23,927 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:23,929 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,057 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,067 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 11:12:24,114 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 11:12:24,136 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:24,146 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,148 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,174 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,180 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:24,181 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68445322, jitterRate=0.01991477608680725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:24,181 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:12:24,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 11:12:24,219 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 11:12:24,219 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 11:12:24,223 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 11:12:24,226 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 11:12:24,272 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 45 msec 2023-07-14 11:12:24,272 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 11:12:24,316 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 11:12:24,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 11:12:24,353 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 11:12:24,359 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 11:12:24,360 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 11:12:24,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 11:12:24,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,380 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 11:12:24,380 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 11:12:24,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 11:12:24,406 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,406 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,417 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,34219,1689333140818, sessionid=0x101637acd630000, setting cluster-up flag (Was=false) 2023-07-14 11:12:24,438 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,445 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 11:12:24,450 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:24,456 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 11:12:24,463 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:24,467 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp 2023-07-14 11:12:24,532 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(951): ClusterId : 611b06e7-c578-40ce-a041-610931460f31 2023-07-14 11:12:24,555 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(951): ClusterId : 611b06e7-c578-40ce-a041-610931460f31 2023-07-14 11:12:24,567 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(951): ClusterId : 611b06e7-c578-40ce-a041-610931460f31 2023-07-14 11:12:24,572 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,572 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,584 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,584 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,584 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,584 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,596 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,602 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,603 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,607 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ReadOnlyZKClient(139): Connect 0x777cc29e to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,623 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ReadOnlyZKClient(139): Connect 0x68820076 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,634 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,634 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,646 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,647 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 11:12:24,653 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,653 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 11:12:24,657 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ReadOnlyZKClient(139): Connect 0x2bae4b76 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,673 DEBUG [RS:1;jenkins-hbase9:45073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50d60007, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,687 DEBUG [RS:1;jenkins-hbase9:45073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f3d7fab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,694 DEBUG [RS:0;jenkins-hbase9:33095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72dd4bd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,694 DEBUG [RS:0;jenkins-hbase9:33095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c354c35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,757 DEBUG [RS:2;jenkins-hbase9:45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2569b073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,758 DEBUG [RS:2;jenkins-hbase9:45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6454ba48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,769 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:45073 2023-07-14 11:12:24,782 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:33095 2023-07-14 11:12:24,787 INFO [RS:0;jenkins-hbase9:33095] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,787 INFO [RS:0;jenkins-hbase9:33095] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,788 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,770 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:45261 2023-07-14 11:12:24,801 INFO [RS:0;jenkins-hbase9:33095] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,789 INFO [RS:1;jenkins-hbase9:45073] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,802 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,802 INFO [RS:2;jenkins-hbase9:45261] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,803 INFO [RS:1;jenkins-hbase9:45073] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,803 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,803 INFO [RS:1;jenkins-hbase9:45073] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,803 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,803 INFO [RS:2;jenkins-hbase9:45261] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,804 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,804 INFO [RS:2;jenkins-hbase9:45261] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,804 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,806 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:33095, startcode=1689333142453 2023-07-14 11:12:24,810 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:45073, startcode=1689333142586 2023-07-14 11:12:24,810 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:45261, startcode=1689333142675 2023-07-14 11:12:24,839 DEBUG [RS:2;jenkins-hbase9:45261] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,841 DEBUG [RS:0;jenkins-hbase9:33095] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,845 DEBUG [RS:1;jenkins-hbase9:45073] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,877 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:24,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 11:12:24,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:24,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:24,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:24,931 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689333174931 2023-07-14 11:12:24,935 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:24,936 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 11:12:24,936 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 11:12:24,944 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:24,949 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54537, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,949 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49411, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,962 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57295, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,968 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,981 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,981 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 11:12:25,016 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 11:12:25,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 11:12:25,019 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 11:12:25,019 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 11:12:25,028 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 11:12:25,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 11:12:25,033 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 11:12:25,042 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 11:12:25,043 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 11:12:25,045 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:25,045 WARN [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:25,046 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:25,046 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:25,046 WARN [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:25,046 WARN [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:25,049 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145046,5,FailOnTimeoutGroup] 2023-07-14 11:12:25,049 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145049,5,FailOnTimeoutGroup] 2023-07-14 11:12:25,050 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,050 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 11:12:25,052 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,052 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,102 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:25,104 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:25,104 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:25,147 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:45073, startcode=1689333142586 2023-07-14 11:12:25,147 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:33095, startcode=1689333142453 2023-07-14 11:12:25,148 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34219,1689333140818 with isa=jenkins-hbase9.apache.org/172.31.2.10:45261, startcode=1689333142675 2023-07-14 11:12:25,158 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,161 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:25,165 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,166 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34219] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,174 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:25,174 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45973 2023-07-14 11:12:25,174 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,179 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:25,180 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45973 2023-07-14 11:12:25,180 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,180 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:25,180 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45973 2023-07-14 11:12:25,180 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 11:12:25,186 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:12:25,187 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ZKUtil(162): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,193 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ZKUtil(162): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,192 WARN [RS:2;jenkins-hbase9:45261] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/info 2023-07-14 11:12:25,197 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ZKUtil(162): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,198 WARN [RS:1;jenkins-hbase9:45073] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,197 INFO [RS:2;jenkins-hbase9:45261] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,193 WARN [RS:0;jenkins-hbase9:33095] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,199 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,199 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 11:12:25,198 INFO [RS:1;jenkins-hbase9:45073] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,199 INFO [RS:0;jenkins-hbase9:33095] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 11:12:25,202 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45073,1689333142586] 2023-07-14 11:12:25,201 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,203 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,207 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45261,1689333142675] 2023-07-14 11:12:25,207 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33095,1689333142453] 2023-07-14 11:12:25,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:25,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 11:12:25,216 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,216 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 11:12:25,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/table 2023-07-14 11:12:25,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 11:12:25,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,224 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ZKUtil(162): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,224 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ZKUtil(162): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,225 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740 2023-07-14 11:12:25,226 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ZKUtil(162): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,226 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740 2023-07-14 11:12:25,226 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ZKUtil(162): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,227 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ZKUtil(162): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,227 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ZKUtil(162): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,227 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ZKUtil(162): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,228 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ZKUtil(162): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,228 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ZKUtil(162): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,253 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,254 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 11:12:25,256 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,256 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,262 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 11:12:25,273 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:25,274 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72417694, jitterRate=0.07910773158073425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 11:12:25,274 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 11:12:25,274 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 11:12:25,275 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 11:12:25,275 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 11:12:25,275 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 11:12:25,276 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 11:12:25,276 INFO [RS:1;jenkins-hbase9:45073] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,279 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 11:12:25,279 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 11:12:25,280 INFO [RS:0;jenkins-hbase9:33095] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,281 INFO [RS:2;jenkins-hbase9:45261] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,290 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:25,290 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 11:12:25,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 11:12:25,308 INFO [RS:1;jenkins-hbase9:45073] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,310 INFO [RS:2;jenkins-hbase9:45261] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,321 INFO [RS:1;jenkins-hbase9:45073] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,321 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,326 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,321 INFO [RS:2;jenkins-hbase9:45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,328 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,334 INFO [RS:0;jenkins-hbase9:33095] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,337 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,339 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 11:12:25,340 INFO [RS:0;jenkins-hbase9:33095] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,340 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,341 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,344 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 11:12:25,346 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,346 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,347 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,346 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,347 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,347 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,347 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,349 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,348 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,350 DEBUG [RS:2;jenkins-hbase9:45261] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,349 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:0;jenkins-hbase9:33095] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,350 DEBUG [RS:1;jenkins-hbase9:45073] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,358 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,358 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,359 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,361 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,362 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,362 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,365 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,366 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,366 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,391 INFO [RS:0;jenkins-hbase9:33095] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,394 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33095,1689333142453-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,408 INFO [RS:1;jenkins-hbase9:45073] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,409 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45073,1689333142586-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,410 INFO [RS:2;jenkins-hbase9:45261] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,410 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45261,1689333142675-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,487 INFO [RS:0;jenkins-hbase9:33095] regionserver.Replication(203): jenkins-hbase9.apache.org,33095,1689333142453 started 2023-07-14 11:12:25,487 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,33095,1689333142453, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33095, sessionid=0x101637acd630001 2023-07-14 11:12:25,490 INFO [RS:1;jenkins-hbase9:45073] regionserver.Replication(203): jenkins-hbase9.apache.org,45073,1689333142586 started 2023-07-14 11:12:25,490 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,491 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45073,1689333142586, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45073, sessionid=0x101637acd630002 2023-07-14 11:12:25,491 DEBUG [RS:0;jenkins-hbase9:33095] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,491 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33095,1689333142453' 2023-07-14 11:12:25,491 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,491 INFO [RS:2;jenkins-hbase9:45261] regionserver.Replication(203): jenkins-hbase9.apache.org,45261,1689333142675 started 2023-07-14 11:12:25,492 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45261,1689333142675, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45261, sessionid=0x101637acd630003 2023-07-14 11:12:25,492 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,493 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,492 DEBUG [RS:2;jenkins-hbase9:45261] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,493 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,494 DEBUG [RS:1;jenkins-hbase9:45073] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,493 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45261,1689333142675' 2023-07-14 11:12:25,494 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45073,1689333142586' 2023-07-14 11:12:25,494 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,494 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,496 DEBUG [jenkins-hbase9:34219] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 11:12:25,498 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,498 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,498 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,498 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,498 DEBUG [RS:0;jenkins-hbase9:33095] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,499 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33095,1689333142453' 2023-07-14 11:12:25,499 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,500 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,500 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,500 DEBUG [RS:2;jenkins-hbase9:45261] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:25,503 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45261,1689333142675' 2023-07-14 11:12:25,503 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,506 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,506 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,506 DEBUG [RS:1;jenkins-hbase9:45073] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:25,506 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45073,1689333142586' 2023-07-14 11:12:25,507 DEBUG [RS:0;jenkins-hbase9:33095] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,507 DEBUG [RS:2;jenkins-hbase9:45261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,507 DEBUG [RS:0;jenkins-hbase9:33095] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,507 INFO [RS:0;jenkins-hbase9:33095] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,507 INFO [RS:0;jenkins-hbase9:33095] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,507 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,507 DEBUG [RS:2;jenkins-hbase9:45261] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,507 DEBUG [jenkins-hbase9:34219] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:25,509 DEBUG [RS:1;jenkins-hbase9:45073] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,508 INFO [RS:2;jenkins-hbase9:45261] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,512 INFO [RS:2;jenkins-hbase9:45261] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,513 DEBUG [RS:1;jenkins-hbase9:45073] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,513 INFO [RS:1;jenkins-hbase9:45073] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,513 INFO [RS:1;jenkins-hbase9:45073] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,520 DEBUG [jenkins-hbase9:34219] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:25,520 DEBUG [jenkins-hbase9:34219] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:25,520 DEBUG [jenkins-hbase9:34219] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:25,520 DEBUG [jenkins-hbase9:34219] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:25,524 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,33095,1689333142453, state=OPENING 2023-07-14 11:12:25,533 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 11:12:25,535 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:25,536 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 11:12:25,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:12:25,622 INFO [RS:2;jenkins-hbase9:45261] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45261%2C1689333142675, suffix=, logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45261,1689333142675, archiveDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs, maxLogs=32 2023-07-14 11:12:25,623 INFO [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33095%2C1689333142453, suffix=, logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,33095,1689333142453, archiveDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs, maxLogs=32 2023-07-14 11:12:25,627 INFO [RS:1;jenkins-hbase9:45073] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45073%2C1689333142586, suffix=, logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45073,1689333142586, archiveDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs, maxLogs=32 2023-07-14 11:12:25,747 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK] 2023-07-14 11:12:25,748 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK] 2023-07-14 11:12:25,747 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK] 2023-07-14 11:12:25,752 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK] 2023-07-14 11:12:25,762 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK] 2023-07-14 11:12:25,772 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK] 2023-07-14 11:12:25,773 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK] 2023-07-14 11:12:25,773 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK] 2023-07-14 11:12:25,773 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK] 2023-07-14 11:12:25,787 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:25,790 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:25,811 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:25,813 INFO [RS:2;jenkins-hbase9:45261] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45261,1689333142675/jenkins-hbase9.apache.org%2C45261%2C1689333142675.1689333145629 2023-07-14 11:12:25,821 DEBUG [RS:2;jenkins-hbase9:45261] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK]] 2023-07-14 11:12:25,822 INFO [RS:1;jenkins-hbase9:45073] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,45073,1689333142586/jenkins-hbase9.apache.org%2C45073%2C1689333142586.1689333145630 2023-07-14 11:12:25,825 DEBUG [RS:1;jenkins-hbase9:45073] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK], DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK]] 2023-07-14 11:12:25,825 INFO [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,33095,1689333142453/jenkins-hbase9.apache.org%2C33095%2C1689333142453.1689333145630 2023-07-14 11:12:25,841 DEBUG [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK], DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK]] 2023-07-14 11:12:25,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 11:12:25,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,871 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33095%2C1689333142453.meta, suffix=.meta, logDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,33095,1689333142453, archiveDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs, maxLogs=32 2023-07-14 11:12:25,895 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK] 2023-07-14 11:12:25,907 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK] 2023-07-14 11:12:25,908 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK] 2023-07-14 11:12:25,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/WALs/jenkins-hbase9.apache.org,33095,1689333142453/jenkins-hbase9.apache.org%2C33095%2C1689333142453.meta.1689333145872.meta 2023-07-14 11:12:25,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38703,DS-f944175f-f679-482e-9ba7-7cfb16d8e898,DISK], DatanodeInfoWithStorage[127.0.0.1:38529,DS-ad82289f-136e-4344-a4b1-bb6ebe6cc2cc,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-681cbe91-453e-46ce-b379-3eac3176d42d,DISK]] 2023-07-14 11:12:25,950 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:25,951 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 11:12:25,953 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:25,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 11:12:25,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 11:12:25,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 11:12:25,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 11:12:25,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:25,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 11:12:25,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 11:12:25,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 11:12:26,000 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/info 2023-07-14 11:12:26,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/info 2023-07-14 11:12:26,001 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 11:12:26,004 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,005 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 11:12:26,007 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:26,007 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:26,008 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 11:12:26,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 11:12:26,012 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/table 2023-07-14 11:12:26,012 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/table 2023-07-14 11:12:26,013 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 11:12:26,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,028 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740 2023-07-14 11:12:26,038 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740 2023-07-14 11:12:26,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 11:12:26,045 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 11:12:26,047 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66331097, jitterRate=-0.01158963143825531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 11:12:26,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 11:12:26,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689333145770 2023-07-14 11:12:26,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 11:12:26,106 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,33095,1689333142453, state=OPEN 2023-07-14 11:12:26,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 11:12:26,110 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 11:12:26,110 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 11:12:26,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 11:12:26,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,33095,1689333142453 in 571 msec 2023-07-14 11:12:26,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 11:12:26,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 825 msec 2023-07-14 11:12:26,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4420 sec 2023-07-14 11:12:26,141 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689333146141, completionTime=-1 2023-07-14 11:12:26,141 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 11:12:26,142 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 11:12:26,241 DEBUG [hconnection-0x234760f4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:26,248 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:26,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 11:12:26,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689333206279 2023-07-14 11:12:26,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689333266279 2023-07-14 11:12:26,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 137 msec 2023-07-14 11:12:26,310 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34219,1689333140818-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,310 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34219,1689333140818-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,311 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34219,1689333140818-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:34219, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,314 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,336 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 11:12:26,338 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 11:12:26,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:26,355 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 11:12:26,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:26,363 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:26,407 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:26,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70 empty. 2023-07-14 11:12:26,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:26,412 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 11:12:26,545 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:26,564 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5881ad6a3f9cfe7bba8d58ba83d1ff70, NAME => 'hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:26,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:26,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5881ad6a3f9cfe7bba8d58ba83d1ff70, disabling compactions & flushes 2023-07-14 11:12:26,618 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:26,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:26,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. after waiting 0 ms 2023-07-14 11:12:26,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:26,619 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:26,619 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5881ad6a3f9cfe7bba8d58ba83d1ff70: 2023-07-14 11:12:26,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:26,659 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333146634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333146634"}]},"ts":"1689333146634"} 2023-07-14 11:12:26,701 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 11:12:26,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:26,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333146704"}]},"ts":"1689333146704"} 2023-07-14 11:12:26,715 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 11:12:26,721 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:26,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:26,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:26,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:26,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:26,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5881ad6a3f9cfe7bba8d58ba83d1ff70, ASSIGN}] 2023-07-14 11:12:26,731 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5881ad6a3f9cfe7bba8d58ba83d1ff70, ASSIGN 2023-07-14 11:12:26,733 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5881ad6a3f9cfe7bba8d58ba83d1ff70, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:12:26,885 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:12:26,887 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5881ad6a3f9cfe7bba8d58ba83d1ff70, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:26,887 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333146887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333146887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333146887"}]},"ts":"1689333146887"} 2023-07-14 11:12:26,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5881ad6a3f9cfe7bba8d58ba83d1ff70, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:12:27,047 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:27,048 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:27,051 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:27,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:27,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5881ad6a3f9cfe7bba8d58ba83d1ff70, NAME => 'hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:27,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. service=AccessControlService 2023-07-14 11:12:27,059 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:27,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:27,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,062 INFO [StoreOpener-5881ad6a3f9cfe7bba8d58ba83d1ff70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,064 DEBUG [StoreOpener-5881ad6a3f9cfe7bba8d58ba83d1ff70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/info 2023-07-14 11:12:27,064 DEBUG [StoreOpener-5881ad6a3f9cfe7bba8d58ba83d1ff70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/info 2023-07-14 11:12:27,065 INFO [StoreOpener-5881ad6a3f9cfe7bba8d58ba83d1ff70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5881ad6a3f9cfe7bba8d58ba83d1ff70 columnFamilyName info 2023-07-14 11:12:27,066 INFO [StoreOpener-5881ad6a3f9cfe7bba8d58ba83d1ff70-1] regionserver.HStore(310): Store=5881ad6a3f9cfe7bba8d58ba83d1ff70/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:27,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:12:27,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:27,078 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5881ad6a3f9cfe7bba8d58ba83d1ff70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63908618, jitterRate=-0.047687381505966187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:27,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5881ad6a3f9cfe7bba8d58ba83d1ff70: 2023-07-14 11:12:27,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70., pid=6, masterSystemTime=1689333147047 2023-07-14 11:12:27,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:27,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:12:27,088 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5881ad6a3f9cfe7bba8d58ba83d1ff70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:27,089 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333147088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333147088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333147088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333147088"}]},"ts":"1689333147088"} 2023-07-14 11:12:27,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 11:12:27,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5881ad6a3f9cfe7bba8d58ba83d1ff70, server=jenkins-hbase9.apache.org,45073,1689333142586 in 203 msec 2023-07-14 11:12:27,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 11:12:27,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5881ad6a3f9cfe7bba8d58ba83d1ff70, ASSIGN in 371 msec 2023-07-14 11:12:27,106 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:27,106 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333147106"}]},"ts":"1689333147106"} 2023-07-14 11:12:27,108 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 11:12:27,112 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:27,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 773 msec 2023-07-14 11:12:27,161 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 11:12:27,163 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,163 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:27,189 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:27,195 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:27,207 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 11:12:27,227 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-14 11:12:27,240 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 11:12:27,252 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-14 11:12:27,268 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 11:12:27,270 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 11:12:27,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.417sec 2023-07-14 11:12:27,276 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 11:12:27,277 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 11:12:27,277 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 11:12:27,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34219,1689333140818-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 11:12:27,280 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34219,1689333140818-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 11:12:27,305 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:27,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 11:12:27,311 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:27,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:27,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 11:12:27,321 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/acl/1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,325 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/acl/1ce932c1300553e884788b15821702aa empty. 2023-07-14 11:12:27,329 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/acl/1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,329 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 11:12:27,332 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,373 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:27,375 DEBUG [Listener at localhost/43501] zookeeper.ReadOnlyZKClient(139): Connect 0x31248683 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:27,377 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ce932c1300553e884788b15821702aa, NAME => 'hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:27,389 DEBUG [Listener at localhost/43501] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@683dee07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:27,437 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,446 DEBUG [hconnection-0x1ea2a9fc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:27,469 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:27,470 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1ce932c1300553e884788b15821702aa, disabling compactions & flushes 2023-07-14 11:12:27,470 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,470 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,470 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. after waiting 0 ms 2023-07-14 11:12:27,470 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,470 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,470 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1ce932c1300553e884788b15821702aa: 2023-07-14 11:12:27,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:27,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333147482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333147482"}]},"ts":"1689333147482"} 2023-07-14 11:12:27,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:27,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 11:12:27,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:27,491 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333147491"}]},"ts":"1689333147491"} 2023-07-14 11:12:27,494 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:12:27,494 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/test.cache.data in system properties and HBase conf 2023-07-14 11:12:27,495 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop.log.dir in system properties and HBase conf 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 11:12:27,495 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:27,496 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/nfs.dump.dir in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 11:12:27,497 INFO [Listener at localhost/43501] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 11:12:27,501 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:27,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:27,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:27,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:27,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:27,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1ce932c1300553e884788b15821702aa, ASSIGN}] 2023-07-14 11:12:27,507 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1ce932c1300553e884788b15821702aa, ASSIGN 2023-07-14 11:12:27,519 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1ce932c1300553e884788b15821702aa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:12:27,643 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,669 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:12:27,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ce932c1300553e884788b15821702aa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:27,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333147679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333147679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333147679"}]},"ts":"1689333147679"} 2023-07-14 11:12:27,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1ce932c1300553e884788b15821702aa, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:12:27,850 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:27,850 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:27,852 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:27,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ce932c1300553e884788b15821702aa, NAME => 'hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:27,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. service=AccessControlService 2023-07-14 11:12:27,861 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:27,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:27,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,866 INFO [StoreOpener-1ce932c1300553e884788b15821702aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,870 DEBUG [StoreOpener-1ce932c1300553e884788b15821702aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/l 2023-07-14 11:12:27,870 DEBUG [StoreOpener-1ce932c1300553e884788b15821702aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/l 2023-07-14 11:12:27,870 INFO [StoreOpener-1ce932c1300553e884788b15821702aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ce932c1300553e884788b15821702aa columnFamilyName l 2023-07-14 11:12:27,871 INFO [StoreOpener-1ce932c1300553e884788b15821702aa-1] regionserver.HStore(310): Store=1ce932c1300553e884788b15821702aa/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:27,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,875 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1ce932c1300553e884788b15821702aa 2023-07-14 11:12:27,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:27,897 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1ce932c1300553e884788b15821702aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60270555, jitterRate=-0.10189874470233917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:27,898 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1ce932c1300553e884788b15821702aa: 2023-07-14 11:12:27,900 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa., pid=11, masterSystemTime=1689333147850 2023-07-14 11:12:27,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,919 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:12:27,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ce932c1300553e884788b15821702aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:27,921 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333147920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333147920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333147920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333147920"}]},"ts":"1689333147920"} 2023-07-14 11:12:27,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 11:12:27,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1ce932c1300553e884788b15821702aa, server=jenkins-hbase9.apache.org,45261,1689333142675 in 240 msec 2023-07-14 11:12:27,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 11:12:27,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1ce932c1300553e884788b15821702aa, ASSIGN in 426 msec 2023-07-14 11:12:27,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:27,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333147936"}]},"ts":"1689333147936"} 2023-07-14 11:12:27,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 11:12:27,944 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:27,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 639 msec 2023-07-14 11:12:28,444 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:28,445 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 11:12:28,477 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 11:12:29,273 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:29,606 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:29,614 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_35617_jobhistory____.mzdl1e/webapp 2023-07-14 11:12:29,825 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 11:12:29,826 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:29,826 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:29,829 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:29,901 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:30,235 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:30,730 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 11:12:30,790 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:35617 2023-07-14 11:12:31,702 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:12:32,018 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:32,019 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 11:12:32,020 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:32,020 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 11:12:32,020 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 11:12:32,020 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 11:12:32,020 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:32,020 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 11:12:32,020 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 11:12:32,021 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 11:12:32,024 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 11:12:32,026 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 11:12:32,027 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 11:12:32,259 WARN [Listener at jenkins-hbase9.apache.org/41509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:32,358 WARN [Listener at jenkins-hbase9.apache.org/41509] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:32,359 INFO [Listener at jenkins-hbase9.apache.org/41509] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:32,366 INFO [Listener at jenkins-hbase9.apache.org/41509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_42745_cluster____6ravxr/webapp 2023-07-14 11:12:32,466 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:32,466 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 11:12:32,466 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:32,467 INFO [Listener at jenkins-hbase9.apache.org/41509] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:32,476 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:32,691 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:32,875 INFO [Listener at jenkins-hbase9.apache.org/41509] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:32,894 INFO [Listener at jenkins-hbase9.apache.org/41509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:42745 2023-07-14 11:12:33,636 WARN [Listener at jenkins-hbase9.apache.org/43595] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:33,663 WARN [Listener at jenkins-hbase9.apache.org/43595] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:33,663 INFO [Listener at jenkins-hbase9.apache.org/43595] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:33,673 INFO [Listener at jenkins-hbase9.apache.org/43595] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_40491_node____dgi4h5/webapp 2023-07-14 11:12:33,745 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 11:12:33,745 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:33,746 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:33,746 INFO [Listener at jenkins-hbase9.apache.org/43595] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:33,754 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,778 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,867 INFO [Listener at jenkins-hbase9.apache.org/43595] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,891 INFO [Listener at jenkins-hbase9.apache.org/43595] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:40491 2023-07-14 11:12:34,436 WARN [Listener at jenkins-hbase9.apache.org/44573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:34,448 WARN [Listener at jenkins-hbase9.apache.org/44573] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:34,449 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:34,460 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46841_node____.5bpgl0/webapp 2023-07-14 11:12:34,540 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 11:12:34,540 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:34,541 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:34,541 INFO [Listener at jenkins-hbase9.apache.org/44573] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:34,551 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,571 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,660 INFO [Listener at jenkins-hbase9.apache.org/44573] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,671 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46841 2023-07-14 11:12:34,725 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 11:12:34,726 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:34,827 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=1241, ProcessCount=184, AvailableMemoryMB=4751 2023-07-14 11:12:34,827 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-14 11:12:34,846 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 11:12:34,853 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 11:12:34,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:12:34,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:34,872 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:34,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 11:12:34,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:34,876 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:34,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:34,887 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 empty. 2023-07-14 11:12:34,888 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:34,888 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:34,890 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 empty. 2023-07-14 11:12:34,893 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:34,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 11:12:34,955 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:34,957 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 428ce89e0dc49bb2fa2426b5dceb3122, NAME => 'testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:34,957 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79ff6a129905273e0158e9f664551ac5, NAME => 'testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:34,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,030 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 428ce89e0dc49bb2fa2426b5dceb3122, disabling compactions & flushes 2023-07-14 11:12:35,031 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. after waiting 0 ms 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,031 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 428ce89e0dc49bb2fa2426b5dceb3122: 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,031 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 79ff6a129905273e0158e9f664551ac5, disabling compactions & flushes 2023-07-14 11:12:35,031 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,032 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,032 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. after waiting 0 ms 2023-07-14 11:12:35,032 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,032 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,032 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 79ff6a129905273e0158e9f664551ac5: 2023-07-14 11:12:35,035 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:35,037 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333155036"}]},"ts":"1689333155036"} 2023-07-14 11:12:35,037 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333155036"}]},"ts":"1689333155036"} 2023-07-14 11:12:35,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:12:35,094 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:35,094 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333155094"}]},"ts":"1689333155094"} 2023-07-14 11:12:35,096 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 11:12:35,104 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:35,106 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:35,106 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:35,106 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:35,106 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:35,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, ASSIGN}] 2023-07-14 11:12:35,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, ASSIGN 2023-07-14 11:12:35,110 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, ASSIGN 2023-07-14 11:12:35,111 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33095,1689333142453; forceNewPlan=false, retain=false 2023-07-14 11:12:35,111 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:12:35,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,261 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:12:35,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=428ce89e0dc49bb2fa2426b5dceb3122, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:35,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=79ff6a129905273e0158e9f664551ac5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:35,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333155263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333155263"}]},"ts":"1689333155263"} 2023-07-14 11:12:35,264 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333155263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333155263"}]},"ts":"1689333155263"} 2023-07-14 11:12:35,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 428ce89e0dc49bb2fa2426b5dceb3122, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:12:35,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 79ff6a129905273e0158e9f664551ac5, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:12:35,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 428ce89e0dc49bb2fa2426b5dceb3122, NAME => 'testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:12:35,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. service=AccessControlService 2023-07-14 11:12:35,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:35,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79ff6a129905273e0158e9f664551ac5, NAME => 'testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:12:35,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. service=AccessControlService 2023-07-14 11:12:35,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:35,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,431 INFO [StoreOpener-428ce89e0dc49bb2fa2426b5dceb3122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,431 INFO [StoreOpener-79ff6a129905273e0158e9f664551ac5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,433 DEBUG [StoreOpener-79ff6a129905273e0158e9f664551ac5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf 2023-07-14 11:12:35,433 DEBUG [StoreOpener-79ff6a129905273e0158e9f664551ac5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf 2023-07-14 11:12:35,433 DEBUG [StoreOpener-428ce89e0dc49bb2fa2426b5dceb3122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf 2023-07-14 11:12:35,433 DEBUG [StoreOpener-428ce89e0dc49bb2fa2426b5dceb3122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf 2023-07-14 11:12:35,437 INFO [StoreOpener-79ff6a129905273e0158e9f664551ac5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79ff6a129905273e0158e9f664551ac5 columnFamilyName cf 2023-07-14 11:12:35,438 INFO [StoreOpener-428ce89e0dc49bb2fa2426b5dceb3122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 428ce89e0dc49bb2fa2426b5dceb3122 columnFamilyName cf 2023-07-14 11:12:35,441 INFO [StoreOpener-79ff6a129905273e0158e9f664551ac5-1] regionserver.HStore(310): Store=79ff6a129905273e0158e9f664551ac5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:35,441 INFO [StoreOpener-428ce89e0dc49bb2fa2426b5dceb3122-1] regionserver.HStore(310): Store=428ce89e0dc49bb2fa2426b5dceb3122/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:35,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:35,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:35,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:35,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 428ce89e0dc49bb2fa2426b5dceb3122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75277568, jitterRate=0.12172317504882812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:35,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:35,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 428ce89e0dc49bb2fa2426b5dceb3122: 2023-07-14 11:12:35,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 79ff6a129905273e0158e9f664551ac5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59715472, jitterRate=-0.11017012596130371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:35,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 79ff6a129905273e0158e9f664551ac5: 2023-07-14 11:12:35,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5., pid=16, masterSystemTime=1689333155421 2023-07-14 11:12:35,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122., pid=15, masterSystemTime=1689333155420 2023-07-14 11:12:35,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=79ff6a129905273e0158e9f664551ac5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:35,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:35,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333155466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333155466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333155466"}]},"ts":"1689333155466"} 2023-07-14 11:12:35,469 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=428ce89e0dc49bb2fa2426b5dceb3122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:35,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333155469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333155469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333155469"}]},"ts":"1689333155469"} 2023-07-14 11:12:35,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 11:12:35,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 79ff6a129905273e0158e9f664551ac5, server=jenkins-hbase9.apache.org,45073,1689333142586 in 203 msec 2023-07-14 11:12:35,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 11:12:35,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, ASSIGN in 375 msec 2023-07-14 11:12:35,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 428ce89e0dc49bb2fa2426b5dceb3122, server=jenkins-hbase9.apache.org,33095,1689333142453 in 208 msec 2023-07-14 11:12:35,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 11:12:35,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, ASSIGN in 384 msec 2023-07-14 11:12:35,495 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:35,495 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333155495"}]},"ts":"1689333155495"} 2023-07-14 11:12:35,497 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 11:12:35,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:35,507 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 11:12:35,514 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:35,519 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:35,524 DEBUG [hconnection-0x73d86ec4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:35,527 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-14 11:12:35,538 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:35,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:35,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,607 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 724 msec 2023-07-14 11:12:35,607 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,615 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,991 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 11:12:35,995 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 11:12:35,996 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:35,999 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:36,024 DEBUG [hconnection-0x1ea2a9fc-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,027 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333156046 (current time:1689333156046). 2023-07-14 11:12:36,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:36,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x510651c7 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c62ff3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,057 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x510651c7 to 127.0.0.1:51121 2023-07-14 11:12:36,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x2072c9d6 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7105, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,071 DEBUG [hconnection-0x1f4ff3be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,072 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,079 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2072c9d6 to 127.0.0.1:51121 2023-07-14 11:12:36,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:36,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:36,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,137 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,138 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689333756138 2023-07-14 11:12:36,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 11:12:36,144 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,147 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:36,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-14 11:12:36,147 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:36,148 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,150 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689333756150 2023-07-14 11:12:36,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,190 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 11:12:36,190 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,191 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 11:12:36,191 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 11:12:36,191 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,191 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,200 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,200 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,200 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,200 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,201 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,201 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,202 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,202 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,206 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,207 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,207 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,207 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,207 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,207 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,208 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,209 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,209 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,209 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,209 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,212 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,212 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,212 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,213 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,213 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,213 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,214 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,214 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,215 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,216 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,216 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbf226d[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbf226d[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:36,221 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 11:12:36,222 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,224 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,224 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:12:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,225 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,225 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,225 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,225 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:36,230 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,230 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,231 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:36,231 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:36,231 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,231 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,231 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,231 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,231 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,232 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. started... 2023-07-14 11:12:36,232 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. started... 2023-07-14 11:12:36,235 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 428ce89e0dc49bb2fa2426b5dceb3122: 2023-07-14 11:12:36,236 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79ff6a129905273e0158e9f664551ac5: 2023-07-14 11:12:36,237 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,237 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,242 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:36,242 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:36,246 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:36,246 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:36,249 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:36,256 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:36,274 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. completed. 2023-07-14 11:12:36,274 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:36,275 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:36,275 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:36,275 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,275 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,275 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:12:36,277 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. completed. 2023-07-14 11:12:36,277 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:36,277 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:36,277 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:36,277 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,277 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,277 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:12:36,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,278 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,278 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,278 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,280 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,280 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,280 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,280 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:12:36,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 11:12:36,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:12:36,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 11:12:36,301 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 11:12:36,301 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:36,301 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:36,301 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,301 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,305 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,306 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,307 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,308 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,311 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,312 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,312 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,325 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,325 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,325 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 11:12:36,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,326 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,326 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,327 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,328 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,328 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,328 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,328 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:12:36,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,456 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:36,459 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:12:36,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 11:12:36,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,468 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689333156141Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689333156348 (+207 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689333156349 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689333156349Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689333156365 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689333156409 (+44 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689333156467 (+58 ms) 2023-07-14 11:12:36,471 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 326 msec 2023-07-14 11:12:36,759 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:36,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33095] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:36,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:36,782 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 11:12:36,783 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:36,783 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:36,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333156797 (current time:1689333156797). 2023-07-14 11:12:36,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:36,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x1d992f4d to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d1ecf9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,811 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d992f4d to 127.0.0.1:51121 2023-07-14 11:12:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x15da2dd4 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416d9b65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,819 DEBUG [hconnection-0x7a34cefb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,821 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,827 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15da2dd4 to 127.0.0.1:51121 2023-07-14 11:12:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:36,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:36,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,834 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,835 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689333756835 2023-07-14 11:12:36,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,835 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 11:12:36,836 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:36,836 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:36,837 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-14 11:12:36,840 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,841 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689333756841 2023-07-14 11:12:36,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 11:12:36,862 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 11:12:36,862 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,863 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 11:12:36,863 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 11:12:36,863 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,863 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,865 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,865 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,865 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,868 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,868 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,868 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,868 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,868 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,870 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:36,870 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:36,871 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,871 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,871 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,871 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:36,874 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,874 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,875 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,875 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,875 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,876 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,876 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,877 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,877 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,877 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,879 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,879 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,879 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,879 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,880 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,880 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4fda0a[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:36,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:36,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4fda0a[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:36,885 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 11:12:36,885 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,889 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,889 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,890 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,890 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:36,890 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:36,890 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. started... 2023-07-14 11:12:36,890 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:36,890 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:36,891 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. started... 2023-07-14 11:12:36,891 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 428ce89e0dc49bb2fa2426b5dceb3122 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 11:12:36,891 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79ff6a129905273e0158e9f664551ac5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 11:12:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:36,938 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:37,041 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1 2023-07-14 11:12:37,041 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2 2023-07-14 11:12:37,088 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/.tmp/cf/b1f1c6721168463fad6ba06e7a78ace0 2023-07-14 11:12:37,090 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/.tmp/cf/04aab1b2fef9484c88fcc046fcff093a 2023-07-14 11:12:37,107 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/.tmp/cf/04aab1b2fef9484c88fcc046fcff093a as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a 2023-07-14 11:12:37,110 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/.tmp/cf/b1f1c6721168463fad6ba06e7a78ace0 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0 2023-07-14 11:12:37,122 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0, entries=4, sequenceid=6, filesize=5.6 K 2023-07-14 11:12:37,126 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 428ce89e0dc49bb2fa2426b5dceb3122 in 235ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:37,126 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 11:12:37,126 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a, entries=46, sequenceid=6, filesize=12.6 K 2023-07-14 11:12:37,130 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 428ce89e0dc49bb2fa2426b5dceb3122: 2023-07-14 11:12:37,131 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,131 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:37,131 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0] hfiles 2023-07-14 11:12:37,132 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,134 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 79ff6a129905273e0158e9f664551ac5 in 243ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:37,138 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:37,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:37,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:37,140 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:12:37,144 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79ff6a129905273e0158e9f664551ac5: 2023-07-14 11:12:37,144 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,144 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:37,144 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a] hfiles 2023-07-14 11:12:37,144 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,189 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. completed. 2023-07-14 11:12:37,190 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:12:37,198 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,198 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,198 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,198 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,202 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. completed. 2023-07-14 11:12:37,202 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:37,202 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:37,202 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:37,202 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,202 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,202 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:12:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,204 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,204 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,204 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,205 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:12:37,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 11:12:37,216 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 11:12:37,216 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:37,216 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:37,216 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 11:12:37,216 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,221 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,220 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,221 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,221 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,222 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,224 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,225 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,225 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,238 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 11:12:37,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 11:12:37,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:12:37,239 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,240 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,241 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,241 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1] mob files 2023-07-14 11:12:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2 2023-07-14 11:12:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1 2023-07-14 11:12:37,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 11:12:37,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 11:12:37,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,371 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689333156835Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689333157266 (+431 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689333157266Loading Region manifests for snaptb0-testExportWithTargetName at 1689333157266Writing data manifest for snaptb0-testExportWithTargetName at 1689333157272 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689333157294 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689333157370 (+76 ms) 2023-07-14 11:12:37,373 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:37,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-14 11:12:37,441 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:37,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:37,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:37,445 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444 2023-07-14 11:12:37,445 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45973, tgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444, rawTgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:37,493 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:37,493 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1043228517_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 11:12:37,493 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 11:12:37,520 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 11:12:37,672 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,673 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,673 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,674 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,674 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,674 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,675 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,763 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-1374349684469837726.jar 2023-07-14 11:12:37,764 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,765 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,765 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,766 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,772 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,773 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:37,774 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:12:37,774 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:12:37,775 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:12:37,776 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:12:37,776 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:12:37,777 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:12:37,777 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:12:37,777 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:12:37,778 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:12:37,779 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:12:37,785 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:37,786 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:37,787 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:37,787 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:37,788 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:37,788 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:37,789 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:39,106 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:12:39,112 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 11:12:39,121 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 11:12:39,565 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:39,567 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:39,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:40,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:12:46,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:49,065 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:53,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:55,140 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:12:55,143 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:12:55,174 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 11:12:55,174 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:12:55,175 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:12:55,175 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 11:12:55,176 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 11:12:55,176 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 11:12:55,176 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/testExportWithTargetName 2023-07-14 11:12:55,177 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 11:12:55,177 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333157444/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 11:12:55,189 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 11:12:55,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 11:12:55,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,215 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175215"}]},"ts":"1689333175215"} 2023-07-14 11:12:55,217 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 11:12:55,219 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 11:12:55,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, UNASSIGN}] 2023-07-14 11:12:55,224 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, UNASSIGN 2023-07-14 11:12:55,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, UNASSIGN 2023-07-14 11:12:55,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=79ff6a129905273e0158e9f664551ac5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:55,225 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=428ce89e0dc49bb2fa2426b5dceb3122, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:55,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333175225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333175225"}]},"ts":"1689333175225"} 2023-07-14 11:12:55,225 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333175225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333175225"}]},"ts":"1689333175225"} 2023-07-14 11:12:55,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 79ff6a129905273e0158e9f664551ac5, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:12:55,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 428ce89e0dc49bb2fa2426b5dceb3122, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:12:55,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:55,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 428ce89e0dc49bb2fa2426b5dceb3122, disabling compactions & flushes 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 79ff6a129905273e0158e9f664551ac5, disabling compactions & flushes 2023-07-14 11:12:55,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:55,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. after waiting 0 ms 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. after waiting 0 ms 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:55,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:12:55,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:55,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122. 2023-07-14 11:12:55,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 428ce89e0dc49bb2fa2426b5dceb3122: 2023-07-14 11:12:55,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:12:55,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:55,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5. 2023-07-14 11:12:55,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 79ff6a129905273e0158e9f664551ac5: 2023-07-14 11:12:55,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:55,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=428ce89e0dc49bb2fa2426b5dceb3122, regionState=CLOSED 2023-07-14 11:12:55,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:55,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175419"}]},"ts":"1689333175419"} 2023-07-14 11:12:55,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=79ff6a129905273e0158e9f664551ac5, regionState=CLOSED 2023-07-14 11:12:55,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175420"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175420"}]},"ts":"1689333175420"} 2023-07-14 11:12:55,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-14 11:12:55,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 428ce89e0dc49bb2fa2426b5dceb3122, server=jenkins-hbase9.apache.org,33095,1689333142453 in 192 msec 2023-07-14 11:12:55,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-14 11:12:55,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 79ff6a129905273e0158e9f664551ac5, server=jenkins-hbase9.apache.org,45073,1689333142586 in 195 msec 2023-07-14 11:12:55,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=428ce89e0dc49bb2fa2426b5dceb3122, UNASSIGN in 204 msec 2023-07-14 11:12:55,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 11:12:55,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79ff6a129905273e0158e9f664551ac5, UNASSIGN in 206 msec 2023-07-14 11:12:55,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175432"}]},"ts":"1689333175432"} 2023-07-14 11:12:55,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 11:12:55,436 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 11:12:55,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 237 msec 2023-07-14 11:12:55,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,517 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 11:12:55,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 11:12:55,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,532 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 11:12:55,535 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,537 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 11:12:55,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:55,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:55,542 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,542 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,542 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,542 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,544 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,544 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,544 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,544 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,546 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/recovered.edits] 2023-07-14 11:12:55,546 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/recovered.edits] 2023-07-14 11:12:55,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 11:12:55,554 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/cf/04aab1b2fef9484c88fcc046fcff093a 2023-07-14 11:12:55,555 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/cf/b1f1c6721168463fad6ba06e7a78ace0 2023-07-14 11:12:55,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122/recovered.edits/9.seqid 2023-07-14 11:12:55,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5/recovered.edits/9.seqid 2023-07-14 11:12:55,560 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/428ce89e0dc49bb2fa2426b5dceb3122 2023-07-14 11:12:55,560 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportWithTargetName/79ff6a129905273e0158e9f664551ac5 2023-07-14 11:12:55,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 11:12:55,560 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 11:12:55,561 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-14 11:12:55,566 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307140d998b478ce9427980aca0048c0d68f2 2023-07-14 11:12:55,568 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307146d8ae8ae54f6411ca654e451906437d1 2023-07-14 11:12:55,568 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 11:12:55,572 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,597 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 11:12:55,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 11:12:55,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 11:12:55,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333175604"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333175604"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,607 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:12:55,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 428ce89e0dc49bb2fa2426b5dceb3122, NAME => 'testtb-testExportWithTargetName,,1689333154865.428ce89e0dc49bb2fa2426b5dceb3122.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 79ff6a129905273e0158e9f664551ac5, NAME => 'testtb-testExportWithTargetName,1,1689333154865.79ff6a129905273e0158e9f664551ac5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:12:55,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 11:12:55,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333175607"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 11:12:55,619 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 96 msec 2023-07-14 11:12:55,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 11:12:55,652 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 11:12:55,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 11:12:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:55,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 11:12:55,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 11:12:55,733 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 708) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1275502835_1 at /127.0.0.1:46870 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:46898 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:43595 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1275502835_1 at /127.0.0.1:53252 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:53266 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x234760f4-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:40095 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:58200 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:43585 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1147 (was 1241), ProcessCount=190 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=3105 (was 4751) 2023-07-14 11:12:55,733 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 11:12:55,764 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=1147, ProcessCount=190, AvailableMemoryMB=3101 2023-07-14 11:12:55,764 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 11:12:55,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:12:55,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:12:55,780 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:55,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 11:12:55,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:55,785 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:55,801 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:55,808 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:55,808 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c empty. 2023-07-14 11:12:55,809 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 empty. 2023-07-14 11:12:55,809 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:55,810 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:55,810 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 11:12:55,845 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:55,849 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e77754a68d87b120411b9859950b3ea0, NAME => 'testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:55,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15d53b30d6b695b29b1e385ffb895a7c, NAME => 'testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:12:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:55,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e77754a68d87b120411b9859950b3ea0, disabling compactions & flushes 2023-07-14 11:12:55,886 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:55,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:55,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. after waiting 0 ms 2023-07-14 11:12:55,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:55,886 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:55,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e77754a68d87b120411b9859950b3ea0: 2023-07-14 11:12:55,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 15d53b30d6b695b29b1e385ffb895a7c, disabling compactions & flushes 2023-07-14 11:12:55,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. after waiting 0 ms 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:55,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:55,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 15d53b30d6b695b29b1e385ffb895a7c: 2023-07-14 11:12:55,898 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:55,899 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333175899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175899"}]},"ts":"1689333175899"} 2023-07-14 11:12:55,899 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333175899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175899"}]},"ts":"1689333175899"} 2023-07-14 11:12:55,903 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:12:55,904 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:55,905 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175905"}]},"ts":"1689333175905"} 2023-07-14 11:12:55,906 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 11:12:55,911 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:55,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:55,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:55,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:55,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:55,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, ASSIGN}] 2023-07-14 11:12:55,917 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, ASSIGN 2023-07-14 11:12:55,917 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, ASSIGN 2023-07-14 11:12:55,918 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:12:55,918 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33095,1689333142453; forceNewPlan=false, retain=false 2023-07-14 11:12:56,068 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:12:56,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e77754a68d87b120411b9859950b3ea0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333176072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333176072"}]},"ts":"1689333176072"} 2023-07-14 11:12:56,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=15d53b30d6b695b29b1e385ffb895a7c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333176073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333176073"}]},"ts":"1689333176073"} 2023-07-14 11:12:56,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e77754a68d87b120411b9859950b3ea0, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:12:56,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 15d53b30d6b695b29b1e385ffb895a7c, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:12:56,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:56,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15d53b30d6b695b29b1e385ffb895a7c, NAME => 'testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. service=AccessControlService 2023-07-14 11:12:56,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e77754a68d87b120411b9859950b3ea0, NAME => 'testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:12:56,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. service=AccessControlService 2023-07-14 11:12:56,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,239 INFO [StoreOpener-15d53b30d6b695b29b1e385ffb895a7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,239 INFO [StoreOpener-e77754a68d87b120411b9859950b3ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,240 DEBUG [StoreOpener-15d53b30d6b695b29b1e385ffb895a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf 2023-07-14 11:12:56,240 DEBUG [StoreOpener-e77754a68d87b120411b9859950b3ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf 2023-07-14 11:12:56,240 DEBUG [StoreOpener-15d53b30d6b695b29b1e385ffb895a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf 2023-07-14 11:12:56,241 DEBUG [StoreOpener-e77754a68d87b120411b9859950b3ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf 2023-07-14 11:12:56,241 INFO [StoreOpener-15d53b30d6b695b29b1e385ffb895a7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15d53b30d6b695b29b1e385ffb895a7c columnFamilyName cf 2023-07-14 11:12:56,241 INFO [StoreOpener-e77754a68d87b120411b9859950b3ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e77754a68d87b120411b9859950b3ea0 columnFamilyName cf 2023-07-14 11:12:56,243 INFO [StoreOpener-15d53b30d6b695b29b1e385ffb895a7c-1] regionserver.HStore(310): Store=15d53b30d6b695b29b1e385ffb895a7c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:56,245 INFO [StoreOpener-e77754a68d87b120411b9859950b3ea0-1] regionserver.HStore(310): Store=e77754a68d87b120411b9859950b3ea0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e77754a68d87b120411b9859950b3ea0 2023-07-14 11:12:56,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:12:56,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:56,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e77754a68d87b120411b9859950b3ea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66534250, jitterRate=-0.008562415838241577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e77754a68d87b120411b9859950b3ea0: 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:56,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 15d53b30d6b695b29b1e385ffb895a7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69768268, jitterRate=0.03962820768356323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:56,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0., pid=30, masterSystemTime=1689333176229 2023-07-14 11:12:56,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 15d53b30d6b695b29b1e385ffb895a7c: 2023-07-14 11:12:56,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c., pid=31, masterSystemTime=1689333176230 2023-07-14 11:12:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,266 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e77754a68d87b120411b9859950b3ea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,266 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176266"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333176266"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333176266"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333176266"}]},"ts":"1689333176266"} 2023-07-14 11:12:56,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=15d53b30d6b695b29b1e385ffb895a7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333176268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333176268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333176268"}]},"ts":"1689333176268"} 2023-07-14 11:12:56,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-14 11:12:56,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e77754a68d87b120411b9859950b3ea0, server=jenkins-hbase9.apache.org,45261,1689333142675 in 195 msec 2023-07-14 11:12:56,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-14 11:12:56,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 15d53b30d6b695b29b1e385ffb895a7c, server=jenkins-hbase9.apache.org,33095,1689333142453 in 195 msec 2023-07-14 11:12:56,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, ASSIGN in 362 msec 2023-07-14 11:12:56,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-14 11:12:56,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, ASSIGN in 368 msec 2023-07-14 11:12:56,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:56,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333176289"}]},"ts":"1689333176289"} 2023-07-14 11:12:56,293 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 11:12:56,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:56,299 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 11:12:56,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,304 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,304 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,304 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,304 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 532 msec 2023-07-14 11:12:56,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:56,396 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 11:12:56,399 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 11:12:56,399 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,400 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:56,409 DEBUG [hconnection-0x1ea2a9fc-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,412 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333176416 (current time:1689333176416). 2023-07-14 11:12:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x63d4750f to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ccb25b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,424 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d4750f to 127.0.0.1:51121 2023-07-14 11:12:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x4bf7ce3e to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bcbb642, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,432 DEBUG [hconnection-0x6df3830a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,434 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,441 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bf7ce3e to 127.0.0.1:51121 2023-07-14 11:12:56,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:56,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,448 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,450 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333776450 2023-07-14 11:12:56,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 11:12:56,451 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:56,451 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:56,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,453 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 11:12:56,456 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,457 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333776457 2023-07-14 11:12:56,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,470 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 11:12:56,470 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,471 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 11:12:56,471 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:12:56,472 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,472 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,473 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,473 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,473 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,473 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,474 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,474 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,475 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,476 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,476 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,476 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,477 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,477 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,477 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,478 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,478 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,478 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,477 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,479 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,479 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,478 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,479 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,479 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,481 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,487 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,487 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,488 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,487 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,488 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,487 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,487 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,489 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,489 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,489 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:56,493 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:12:56,493 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,495 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. started... 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15d53b30d6b695b29b1e385ffb895a7c: 2023-07-14 11:12:56,495 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,496 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,495 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,496 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,495 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. started... 2023-07-14 11:12:56,496 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:56,498 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e77754a68d87b120411b9859950b3ea0: 2023-07-14 11:12:56,499 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,499 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,499 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:56,499 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,500 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:56,501 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,501 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,501 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,530 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. completed. 2023-07-14 11:12:56,530 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:12:56,534 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,537 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. completed. 2023-07-14 11:12:56,537 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,537 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:12:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,540 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,540 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,540 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,540 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:12:56,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:12:56,550 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 11:12:56,551 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:56,551 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:56,551 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:56,552 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:56,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:56,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,553 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,554 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,555 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,555 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,557 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,559 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,560 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,561 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,568 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,568 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,568 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,569 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,569 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,568 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 11:12:56,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:12:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,569 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,569 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,568 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,573 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,574 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 11:12:56,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,658 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689333176450Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689333176589 (+139 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689333176589Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689333176590 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689333176594 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689333176610 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689333176658 (+48 ms) 2023-07-14 11:12:56,662 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 211 msec 2023-07-14 11:12:56,754 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:56,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:56,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:56,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33095] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:56,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45261] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:56,765 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 11:12:56,766 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,766 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:56,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333176778 (current time:1689333176778). 2023-07-14 11:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:56,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x61433494 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@796602b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,791 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61433494 to 127.0.0.1:51121 2023-07-14 11:12:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x51588d13 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60fd380d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,802 DEBUG [hconnection-0x314dac25-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,803 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,809 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51588d13 to 127.0.0.1:51121 2023-07-14 11:12:56,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:56,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,816 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,818 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333776818 2023-07-14 11:12:56,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 11:12:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,819 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:56,820 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:56,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,821 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-14 11:12:56,824 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,824 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333776824 2023-07-14 11:12:56,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 11:12:56,850 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 11:12:56,850 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,852 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 11:12:56,852 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:12:56,853 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,853 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,856 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,856 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,856 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,856 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,857 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,857 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:56,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:56,858 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,858 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:56,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,860 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,861 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,865 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,866 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,867 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,866 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,867 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,867 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,868 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,868 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,869 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,869 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,870 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,870 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,870 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,870 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,872 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56dc5420[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:56,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56dc5420[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:56,875 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:12:56,875 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:56,878 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,877 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,877 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,878 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,878 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,878 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:12:56,879 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,879 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,880 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,883 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,883 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,883 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,883 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,883 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:56,883 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,883 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,883 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,883 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. started... 2023-07-14 11:12:56,883 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. started... 2023-07-14 11:12:56,883 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15d53b30d6b695b29b1e385ffb895a7c 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 11:12:56,883 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e77754a68d87b120411b9859950b3ea0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 11:12:56,920 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:56,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:56,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:56,921 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:56,933 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb 2023-07-14 11:12:56,939 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5 2023-07-14 11:12:56,952 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/.tmp/cf/d4d76faa2daa4233b8997ab593d3420f 2023-07-14 11:12:56,957 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/.tmp/cf/527a1be8370645969a43ba2b6e9086d3 2023-07-14 11:12:56,960 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/.tmp/cf/d4d76faa2daa4233b8997ab593d3420f as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f 2023-07-14 11:12:56,963 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/.tmp/cf/527a1be8370645969a43ba2b6e9086d3 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3 2023-07-14 11:12:56,965 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 11:12:56,967 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 15d53b30d6b695b29b1e385ffb895a7c in 84ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:56,967 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 11:12:56,967 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15d53b30d6b695b29b1e385ffb895a7c: 2023-07-14 11:12:56,968 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:56,968 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,968 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f] hfiles 2023-07-14 11:12:56,968 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:56,968 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3, entries=45, sequenceid=6, filesize=12.5 K 2023-07-14 11:12:56,969 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e77754a68d87b120411b9859950b3ea0 in 86ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:56,971 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e77754a68d87b120411b9859950b3ea0: 2023-07-14 11:12:56,971 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:56,971 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,971 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3] hfiles 2023-07-14 11:12:56,971 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:56,980 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. completed. 2023-07-14 11:12:56,980 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:12:56,980 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,980 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,980 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,980 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,980 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:12:56,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,986 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,986 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,986 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:56,995 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. completed. 2023-07-14 11:12:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:12:56,995 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:12:56,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:12:56,995 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,995 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,995 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,996 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,996 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:12:56,997 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,998 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,998 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,998 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:57,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:12:57,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:12:57,008 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 11:12:57,009 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:57,009 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:57,009 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 11:12:57,009 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,011 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,012 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,012 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,013 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,015 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,015 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,016 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,020 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:57,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,020 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,021 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 11:12:57,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:12:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,022 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:12:57,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,023 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb] mob files 2023-07-14 11:12:57,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5 2023-07-14 11:12:57,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb 2023-07-14 11:12:57,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 11:12:57,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,121 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:57,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:57,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:57,126 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:12:57,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 11:12:57,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,172 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689333176818Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689333177034 (+216 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689333177034Loading Region manifests for snaptb0-testExportFileSystemState at 1689333177034Writing data manifest for snaptb0-testExportFileSystemState at 1689333177038 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689333177053 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689333177171 (+118 ms) 2023-07-14 11:12:57,175 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:57,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 356 msec 2023-07-14 11:12:57,426 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:57,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:57,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:57,427 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427 2023-07-14 11:12:57,427 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45973, tgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427, rawTgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:57,451 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:12:57,451 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-830146821_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,451 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 11:12:57,466 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,911 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,912 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,912 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,913 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,913 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,914 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,914 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,984 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-1753857502066896662.jar 2023-07-14 11:12:57,985 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,985 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,986 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,986 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,987 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,987 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,988 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:12:57,988 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:12:57,989 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:12:57,990 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:12:57,990 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:12:57,991 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:12:57,991 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:12:57,992 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:12:57,992 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:12:57,993 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:12:57,994 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,994 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,995 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:57,995 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,996 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,996 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:57,997 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:59,425 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:12:59,428 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 11:12:59,430 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 11:12:59,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:59,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:59,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0001_000001 (auth:SIMPLE) 2023-07-14 11:13:00,629 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:01,009 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:13:06,910 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:09,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:13,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:15,210 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:13:15,213 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:13:15,240 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 11:13:15,240 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:13:15,240 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:13:15,241 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:13:15,241 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 11:13:15,242 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 11:13:15,242 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:13:15,242 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 11:13:15,242 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333177427/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 11:13:15,257 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 11:13:15,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 11:13:15,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:15,264 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333195264"}]},"ts":"1689333195264"} 2023-07-14 11:13:15,266 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 11:13:15,268 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 11:13:15,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, UNASSIGN}] 2023-07-14 11:13:15,272 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, UNASSIGN 2023-07-14 11:13:15,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, UNASSIGN 2023-07-14 11:13:15,273 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e77754a68d87b120411b9859950b3ea0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:15,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=15d53b30d6b695b29b1e385ffb895a7c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:15,274 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333195273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333195273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333195273"}]},"ts":"1689333195273"} 2023-07-14 11:13:15,274 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333195273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333195273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333195273"}]},"ts":"1689333195273"} 2023-07-14 11:13:15,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e77754a68d87b120411b9859950b3ea0, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:13:15,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 15d53b30d6b695b29b1e385ffb895a7c, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:13:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:15,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e77754a68d87b120411b9859950b3ea0 2023-07-14 11:13:15,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e77754a68d87b120411b9859950b3ea0, disabling compactions & flushes 2023-07-14 11:13:15,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:13:15,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:13:15,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. after waiting 0 ms 2023-07-14 11:13:15,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:13:15,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:13:15,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 15d53b30d6b695b29b1e385ffb895a7c, disabling compactions & flushes 2023-07-14 11:13:15,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:13:15,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:13:15,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. after waiting 0 ms 2023-07-14 11:13:15,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:13:15,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:15,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:15,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:15,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:15,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0. 2023-07-14 11:13:15,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c. 2023-07-14 11:13:15,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e77754a68d87b120411b9859950b3ea0: 2023-07-14 11:13:15,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 15d53b30d6b695b29b1e385ffb895a7c: 2023-07-14 11:13:15,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:13:15,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=15d53b30d6b695b29b1e385ffb895a7c, regionState=CLOSED 2023-07-14 11:13:15,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e77754a68d87b120411b9859950b3ea0 2023-07-14 11:13:15,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333195450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333195450"}]},"ts":"1689333195450"} 2023-07-14 11:13:15,451 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e77754a68d87b120411b9859950b3ea0, regionState=CLOSED 2023-07-14 11:13:15,451 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333195451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333195451"}]},"ts":"1689333195451"} 2023-07-14 11:13:15,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 11:13:15,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 15d53b30d6b695b29b1e385ffb895a7c, server=jenkins-hbase9.apache.org,33095,1689333142453 in 176 msec 2023-07-14 11:13:15,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 11:13:15,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e77754a68d87b120411b9859950b3ea0, server=jenkins-hbase9.apache.org,45261,1689333142675 in 178 msec 2023-07-14 11:13:15,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=15d53b30d6b695b29b1e385ffb895a7c, UNASSIGN in 185 msec 2023-07-14 11:13:15,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 11:13:15,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e77754a68d87b120411b9859950b3ea0, UNASSIGN in 186 msec 2023-07-14 11:13:15,459 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333195459"}]},"ts":"1689333195459"} 2023-07-14 11:13:15,460 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 11:13:15,462 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 11:13:15,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 205 msec 2023-07-14 11:13:15,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:15,567 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 11:13:15,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 11:13:15,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 11:13:15,580 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 11:13:15,585 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,585 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,585 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,585 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:15,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:15,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:15,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:15,586 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:13:15,587 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,587 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,588 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:15,588 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 11:13:15,590 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/recovered.edits] 2023-07-14 11:13:15,590 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/recovered.edits] 2023-07-14 11:13:15,595 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/cf/d4d76faa2daa4233b8997ab593d3420f 2023-07-14 11:13:15,596 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/cf/527a1be8370645969a43ba2b6e9086d3 2023-07-14 11:13:15,600 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0/recovered.edits/9.seqid 2023-07-14 11:13:15,602 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/e77754a68d87b120411b9859950b3ea0 2023-07-14 11:13:15,604 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c/recovered.edits/9.seqid 2023-07-14 11:13:15,605 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemState/15d53b30d6b695b29b1e385ffb895a7c 2023-07-14 11:13:15,605 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 11:13:15,606 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 11:13:15,607 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-14 11:13:15,612 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714aed745f4e023406dbc8ae3065773a7b5 2023-07-14 11:13:15,613 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307140df5368ff58e4304a2ac66d33af6e8fb 2023-07-14 11:13:15,614 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 11:13:15,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,619 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 11:13:15,624 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 11:13:15,626 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,626 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 11:13:15,626 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333195626"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:15,626 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333195626"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:15,632 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:13:15,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15d53b30d6b695b29b1e385ffb895a7c, NAME => 'testtb-testExportFileSystemState,,1689333175771.15d53b30d6b695b29b1e385ffb895a7c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e77754a68d87b120411b9859950b3ea0, NAME => 'testtb-testExportFileSystemState,1,1689333175771.e77754a68d87b120411b9859950b3ea0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:13:15,632 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 11:13:15,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333195632"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:15,634 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 11:13:15,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:15,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 69 msec 2023-07-14 11:13:15,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 11:13:15,690 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 11:13:15,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 11:13:15,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 11:13:15,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 11:13:15,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 11:13:15,744 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:42576 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1908672753_1 at /127.0.0.1:42562 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2147 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:47360 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:40278 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1908672753_1 at /127.0.0.1:47338 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:44573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:42269 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 937) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=968 (was 1147), ProcessCount=190 (was 190), AvailableMemoryMB=2402 (was 3101) 2023-07-14 11:13:15,744 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-14 11:13:15,766 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=968, ProcessCount=190, AvailableMemoryMB=2402 2023-07-14 11:13:15,767 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-14 11:13:15,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:13:15,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:15,774 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:13:15,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 11:13:15,775 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:13:15,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:15,780 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:15,780 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:15,781 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca empty. 2023-07-14 11:13:15,781 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 empty. 2023-07-14 11:13:15,782 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:15,782 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:15,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 11:13:15,797 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 11:13:15,798 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 830631b8ca957fb6c8c33ec7870690ca, NAME => 'testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:13:15,800 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 321e8f55a8760f784fce4df282b2aee3, NAME => 'testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 830631b8ca957fb6c8c33ec7870690ca, disabling compactions & flushes 2023-07-14 11:13:15,873 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. after waiting 0 ms 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:15,873 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:15,873 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 830631b8ca957fb6c8c33ec7870690ca: 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 321e8f55a8760f784fce4df282b2aee3, disabling compactions & flushes 2023-07-14 11:13:15,879 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. after waiting 0 ms 2023-07-14 11:13:15,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:15,879 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:15,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 321e8f55a8760f784fce4df282b2aee3: 2023-07-14 11:13:15,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:13:15,884 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333195884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333195884"}]},"ts":"1689333195884"} 2023-07-14 11:13:15,884 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333195884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333195884"}]},"ts":"1689333195884"} 2023-07-14 11:13:15,887 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:13:15,888 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:13:15,889 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333195889"}]},"ts":"1689333195889"} 2023-07-14 11:13:15,891 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 11:13:15,894 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:13:15,896 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:13:15,896 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:13:15,896 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:13:15,896 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:13:15,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, ASSIGN}] 2023-07-14 11:13:15,899 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, ASSIGN 2023-07-14 11:13:15,900 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, ASSIGN 2023-07-14 11:13:15,908 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33095,1689333142453; forceNewPlan=false, retain=false 2023-07-14 11:13:15,908 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:13:16,058 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:13:16,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=321e8f55a8760f784fce4df282b2aee3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=830631b8ca957fb6c8c33ec7870690ca, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333196062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333196062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333196062"}]},"ts":"1689333196062"} 2023-07-14 11:13:16,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333196062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333196062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333196062"}]},"ts":"1689333196062"} 2023-07-14 11:13:16,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 321e8f55a8760f784fce4df282b2aee3, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:13:16,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 830631b8ca957fb6c8c33ec7870690ca, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:13:16,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:16,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 830631b8ca957fb6c8c33ec7870690ca, NAME => 'testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:13:16,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. service=AccessControlService 2023-07-14 11:13:16,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:16,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:16,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 321e8f55a8760f784fce4df282b2aee3, NAME => 'testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. service=AccessControlService 2023-07-14 11:13:16,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:16,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,232 INFO [StoreOpener-321e8f55a8760f784fce4df282b2aee3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,232 INFO [StoreOpener-830631b8ca957fb6c8c33ec7870690ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,234 DEBUG [StoreOpener-321e8f55a8760f784fce4df282b2aee3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf 2023-07-14 11:13:16,234 DEBUG [StoreOpener-321e8f55a8760f784fce4df282b2aee3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf 2023-07-14 11:13:16,234 INFO [StoreOpener-321e8f55a8760f784fce4df282b2aee3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 321e8f55a8760f784fce4df282b2aee3 columnFamilyName cf 2023-07-14 11:13:16,234 DEBUG [StoreOpener-830631b8ca957fb6c8c33ec7870690ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf 2023-07-14 11:13:16,235 DEBUG [StoreOpener-830631b8ca957fb6c8c33ec7870690ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf 2023-07-14 11:13:16,235 INFO [StoreOpener-830631b8ca957fb6c8c33ec7870690ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 830631b8ca957fb6c8c33ec7870690ca columnFamilyName cf 2023-07-14 11:13:16,236 INFO [StoreOpener-321e8f55a8760f784fce4df282b2aee3-1] regionserver.HStore(310): Store=321e8f55a8760f784fce4df282b2aee3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:16,237 INFO [StoreOpener-830631b8ca957fb6c8c33ec7870690ca-1] regionserver.HStore(310): Store=830631b8ca957fb6c8c33ec7870690ca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:16,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:13:16,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:13:16,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:16,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 321e8f55a8760f784fce4df282b2aee3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74467928, jitterRate=0.10965859889984131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:16,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 321e8f55a8760f784fce4df282b2aee3: 2023-07-14 11:13:16,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3., pid=45, masterSystemTime=1689333196220 2023-07-14 11:13:16,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:16,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 830631b8ca957fb6c8c33ec7870690ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70252395, jitterRate=0.04684226214885712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:16,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 830631b8ca957fb6c8c33ec7870690ca: 2023-07-14 11:13:16,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:16,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:16,251 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=321e8f55a8760f784fce4df282b2aee3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca., pid=46, masterSystemTime=1689333196220 2023-07-14 11:13:16,251 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333196251"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333196251"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333196251"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333196251"}]},"ts":"1689333196251"} 2023-07-14 11:13:16,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=830631b8ca957fb6c8c33ec7870690ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,254 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333196253"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333196253"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333196253"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333196253"}]},"ts":"1689333196253"} 2023-07-14 11:13:16,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-14 11:13:16,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 321e8f55a8760f784fce4df282b2aee3, server=jenkins-hbase9.apache.org,45073,1689333142586 in 188 msec 2023-07-14 11:13:16,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-14 11:13:16,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 830631b8ca957fb6c8c33ec7870690ca, server=jenkins-hbase9.apache.org,33095,1689333142453 in 192 msec 2023-07-14 11:13:16,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, ASSIGN in 366 msec 2023-07-14 11:13:16,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 11:13:16,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, ASSIGN in 367 msec 2023-07-14 11:13:16,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:13:16,267 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333196267"}]},"ts":"1689333196267"} 2023-07-14 11:13:16,269 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 11:13:16,271 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:13:16,272 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 11:13:16,275 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:16,281 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:16,281 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:16,281 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:16,281 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:16,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:16,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:16,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:16,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:16,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 514 msec 2023-07-14 11:13:16,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:16,382 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 11:13:16,385 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 11:13:16,385 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,387 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:16,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333196410 (current time:1689333196410). 2023-07-14 11:13:16,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:13:16,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x0cc431e9 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:16,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4da5cecf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:16,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,423 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cc431e9 to 127.0.0.1:51121 2023-07-14 11:13:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x200a5e37 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:16,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dec78a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:16,442 DEBUG [hconnection-0x6edc1c62-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,446 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,452 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x200a5e37 to 127.0.0.1:51121 2023-07-14 11:13:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:13:16,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,459 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,462 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689333796462 2023-07-14 11:13:16,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 11:13:16,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,463 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:13:16,463 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:13:16,464 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-14 11:13:16,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,467 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,468 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689333796468 2023-07-14 11:13:16,564 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:16,565 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:13:16,765 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:16,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:16,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:16,767 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:13:16,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,889 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 11:13:16,889 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,889 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 11:13:16,889 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 11:13:16,889 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,890 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,891 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,891 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,891 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,891 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,892 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,892 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,893 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:16,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,894 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,894 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,897 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,898 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,898 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,898 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,898 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,899 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,899 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,899 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,899 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,899 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,903 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,904 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,904 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,905 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,905 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,905 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,907 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,907 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 1] remaining members to acquire global barrier 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:16,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 0] remaining members to acquire global barrier 2023-07-14 11:13:16,913 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 11:13:16,913 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,916 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,917 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,917 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,917 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,917 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,917 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,918 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:13:16,917 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,917 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:16,918 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:16,918 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. started... 2023-07-14 11:13:16,918 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 830631b8ca957fb6c8c33ec7870690ca: 2023-07-14 11:13:16,918 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,918 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:13:16,919 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,919 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:16,919 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:16,919 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:16,919 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:16,919 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:16,920 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. started... 2023-07-14 11:13:16,922 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 321e8f55a8760f784fce4df282b2aee3: 2023-07-14 11:13:16,922 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,923 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:16,923 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:16,923 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,923 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,923 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,958 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. completed. 2023-07-14 11:13:16,958 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:16,958 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:16,958 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. completed. 2023-07-14 11:13:16,958 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:16,958 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,959 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:13:16,961 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,961 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,961 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,961 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,962 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,961 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,961 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,964 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:13:16,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 11:13:16,973 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 11:13:16,973 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:13:16,973 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:13:16,973 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,973 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,977 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,978 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,979 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,979 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,982 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,983 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,983 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 11:13:16,986 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:13:16,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,986 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,989 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:13:16,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:17,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:17,068 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:17,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:17,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:17,070 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:13:17,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:17,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 11:13:17,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:17,459 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:17,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689333196462Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689333197015 (+553 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689333197015Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689333197015Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689333197023 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689333197432 (+409 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689333197458 (+26 ms) 2023-07-14 11:13:17,464 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:17,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.0010 sec 2023-07-14 11:13:17,570 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:17,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:17,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:13:17,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33095] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:13:17,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:13:17,585 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 11:13:17,585 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:17,585 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:17,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:17,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333197599 (current time:1689333197599). 2023-07-14 11:13:17,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:13:17,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x2b05819d to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:17,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75d8e220, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:17,618 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:17,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b05819d to 127.0.0.1:51121 2023-07-14 11:13:17,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:17,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x72342bad to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:17,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75ba551f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:17,629 DEBUG [hconnection-0x47c1706a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:17,632 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:17,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:17,640 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72342bad to 127.0.0.1:51121 2023-07-14 11:13:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:17,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:13:17,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:17,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:17,649 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:17,651 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689333797651 2023-07-14 11:13:17,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:17,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 11:13:17,652 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:13:17,652 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:13:17,653 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:17,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:17,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-14 11:13:17,656 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:17,657 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689333797657 2023-07-14 11:13:17,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 11:13:17,680 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 11:13:17,680 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:17,682 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 11:13:17,682 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 11:13:17,682 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,682 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,683 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,684 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,684 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,685 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:17,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:17,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:17,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:17,686 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:17,686 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:17,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:17,686 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:17,686 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:17,687 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:17,687 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:17,686 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:17,689 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:17,687 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:17,690 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:17,692 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,694 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,694 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,694 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,694 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,694 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:17,694 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,695 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,695 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:17,695 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,695 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 1] remaining members to acquire global barrier 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:17,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:17,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 0] remaining members to acquire global barrier 2023-07-14 11:13:17,701 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 11:13:17,701 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,702 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,702 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:13:17,702 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:17,703 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:17,703 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:17,704 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:17,704 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,704 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:13:17,704 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:17,704 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. started... 2023-07-14 11:13:17,704 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. started... 2023-07-14 11:13:17,704 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 830631b8ca957fb6c8c33ec7870690ca 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-14 11:13:17,704 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 321e8f55a8760f784fce4df282b2aee3 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-14 11:13:17,705 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:17,705 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:17,705 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:17,733 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b 2023-07-14 11:13:17,739 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7 2023-07-14 11:13:17,744 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/.tmp/cf/c7307124fc7344fab9bb57521f919362 2023-07-14 11:13:17,752 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:17,753 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/.tmp/cf/13c7c9f1104d4148a9e11ac6813eeb77 2023-07-14 11:13:17,755 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/.tmp/cf/c7307124fc7344fab9bb57521f919362 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362 2023-07-14 11:13:17,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:17,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:17,759 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:13:17,760 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/.tmp/cf/13c7c9f1104d4148a9e11ac6813eeb77 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77 2023-07-14 11:13:17,762 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362, entries=1, sequenceid=6, filesize=5.1 K 2023-07-14 11:13:17,766 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 830631b8ca957fb6c8c33ec7870690ca in 62ms, sequenceid=6, compaction requested=false 2023-07-14 11:13:17,766 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 11:13:17,766 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 830631b8ca957fb6c8c33ec7870690ca: 2023-07-14 11:13:17,767 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:17,767 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:17,767 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362] hfiles 2023-07-14 11:13:17,767 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:17,769 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77, entries=49, sequenceid=6, filesize=13.0 K 2023-07-14 11:13:17,770 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 321e8f55a8760f784fce4df282b2aee3 in 65ms, sequenceid=6, compaction requested=false 2023-07-14 11:13:17,771 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 321e8f55a8760f784fce4df282b2aee3: 2023-07-14 11:13:17,772 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:17,772 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:17,772 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77] hfiles 2023-07-14 11:13:17,772 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:17,795 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. completed. 2023-07-14 11:13:17,795 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:13:17,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:17,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:17,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:17,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:13:17,797 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,797 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:17,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:17,797 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:17,798 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:17,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:17,803 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. completed. 2023-07-14 11:13:17,803 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:13:17,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,803 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:17,803 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:17,803 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,803 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:17,803 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:13:17,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,806 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:17,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,806 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:17,806 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,806 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:13:17,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 11:13:17,814 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 11:13:17,814 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:13:17,814 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:13:17,814 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 11:13:17,814 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:13:17,817 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,817 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,817 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:17,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,818 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,819 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,820 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,822 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,823 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:17,823 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-14 11:13:17,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 11:13:17,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 11:13:17,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:17,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:13:17,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:13:17,832 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:17,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:17,831 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:17,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b] mob files 2023-07-14 11:13:17,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7 2023-07-14 11:13:17,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b 2023-07-14 11:13:17,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:17,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:17,832 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,836 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:13:17,836 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:13:17,836 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,836 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 11:13:17,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,959 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:17,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:17,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:17,961 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:13:18,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 11:13:18,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:18,004 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:18,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689333197651Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689333197860 (+209 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689333197860Loading Region manifests for snaptb0-testConsecutiveExports at 1689333197861 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689333197865 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689333197903 (+38 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689333198003 (+100 ms) 2023-07-14 11:13:18,007 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:18,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 355 msec 2023-07-14 11:13:18,261 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:18,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:18,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:13:18,263 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263 2023-07-14 11:13:18,264 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:13:18,294 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:13:18,294 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6fcca677, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:18,295 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 11:13:18,305 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:18,340 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,341 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,342 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,342 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,343 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,343 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,344 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,429 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-3699628014568525133.jar 2023-07-14 11:13:18,430 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,430 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,430 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,431 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,431 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,431 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:18,431 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:13:18,432 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:13:18,432 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:13:18,433 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:13:18,433 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:13:18,433 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:13:18,434 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:13:18,434 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:13:18,434 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:13:18,435 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:13:18,435 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:18,436 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:18,436 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:18,436 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:18,436 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:18,437 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:18,438 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:19,352 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:13:19,355 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 11:13:19,358 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 11:13:19,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:19,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:19,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:20,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:21,053 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:13:26,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:29,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:32,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:34,587 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:13:34,587 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:13:34,597 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 11:13:34,597 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:13:34,598 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:13:34,599 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:34,602 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:34,602 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:34,602 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e122ff5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:34,602 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:34,602 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:34,604 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:13:34,631 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:13:34,632 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@771f0ac4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:34,632 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 11:13:34,657 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:34,728 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,728 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,730 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,730 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,818 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-8309461674941670285.jar 2023-07-14 11:13:34,819 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,819 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,820 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,820 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,820 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,821 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:34,821 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:13:34,822 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:13:34,822 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:13:34,823 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:13:34,823 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:13:34,823 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:13:34,824 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:13:34,824 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:13:34,825 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:13:34,825 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:13:34,826 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:34,826 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:34,827 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:34,827 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:34,827 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:34,828 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:34,828 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:35,716 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:13:35,727 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 11:13:35,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 11:13:38,982 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:38,982 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:38,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:39,853 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:50,030 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:52,602 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:58,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0004_000001 (auth:SIMPLE) 2023-07-14 11:14:00,126 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:14:00,126 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:14:00,134 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 11:14:00,134 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:14:00,135 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:14:00,135 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:14:00,140 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:14:00,141 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:14:00,141 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e122ff5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:14:00,141 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:14:00,141 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/local-export-1689333198263/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:14:00,162 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 11:14:00,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 11:14:00,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:14:00,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333240174"}]},"ts":"1689333240174"} 2023-07-14 11:14:00,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 11:14:00,179 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 11:14:00,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, UNASSIGN}] 2023-07-14 11:14:00,185 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, UNASSIGN 2023-07-14 11:14:00,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, UNASSIGN 2023-07-14 11:14:00,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=830631b8ca957fb6c8c33ec7870690ca, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:00,186 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333240186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333240186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333240186"}]},"ts":"1689333240186"} 2023-07-14 11:14:00,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=321e8f55a8760f784fce4df282b2aee3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:00,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333240187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333240187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333240187"}]},"ts":"1689333240187"} 2023-07-14 11:14:00,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 830631b8ca957fb6c8c33ec7870690ca, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:14:00,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 321e8f55a8760f784fce4df282b2aee3, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:00,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:14:00,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:14:00,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 830631b8ca957fb6c8c33ec7870690ca, disabling compactions & flushes 2023-07-14 11:14:00,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:14:00,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:14:00,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. after waiting 0 ms 2023-07-14 11:14:00,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:14:00,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:14:00,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 321e8f55a8760f784fce4df282b2aee3, disabling compactions & flushes 2023-07-14 11:14:00,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:14:00,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:14:00,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. after waiting 0 ms 2023-07-14 11:14:00,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:14:00,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:00,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:00,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:00,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:00,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3. 2023-07-14 11:14:00,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 321e8f55a8760f784fce4df282b2aee3: 2023-07-14 11:14:00,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca. 2023-07-14 11:14:00,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 830631b8ca957fb6c8c33ec7870690ca: 2023-07-14 11:14:00,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:14:00,393 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=321e8f55a8760f784fce4df282b2aee3, regionState=CLOSED 2023-07-14 11:14:00,393 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333240393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333240393"}]},"ts":"1689333240393"} 2023-07-14 11:14:00,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=830631b8ca957fb6c8c33ec7870690ca, regionState=CLOSED 2023-07-14 11:14:00,397 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333240396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333240396"}]},"ts":"1689333240396"} 2023-07-14 11:14:00,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:14:00,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-14 11:14:00,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 321e8f55a8760f784fce4df282b2aee3, server=jenkins-hbase9.apache.org,45073,1689333142586 in 206 msec 2023-07-14 11:14:00,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=321e8f55a8760f784fce4df282b2aee3, UNASSIGN in 217 msec 2023-07-14 11:14:00,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-14 11:14:00,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 830631b8ca957fb6c8c33ec7870690ca, server=jenkins-hbase9.apache.org,33095,1689333142453 in 210 msec 2023-07-14 11:14:00,408 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 11:14:00,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=830631b8ca957fb6c8c33ec7870690ca, UNASSIGN in 223 msec 2023-07-14 11:14:00,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333240409"}]},"ts":"1689333240409"} 2023-07-14 11:14:00,411 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 11:14:00,413 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 11:14:00,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 251 msec 2023-07-14 11:14:00,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:14:00,478 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 11:14:00,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 11:14:00,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,483 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 11:14:00,484 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,488 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 11:14:00,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:14:00,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:14:00,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:14:00,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:14:00,492 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:00,493 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:00,494 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:14:00,494 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:00,494 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:14:00,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 11:14:00,496 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/recovered.edits] 2023-07-14 11:14:00,497 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/recovered.edits] 2023-07-14 11:14:00,502 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/cf/c7307124fc7344fab9bb57521f919362 2023-07-14 11:14:00,503 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/cf/13c7c9f1104d4148a9e11ac6813eeb77 2023-07-14 11:14:00,507 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca/recovered.edits/9.seqid 2023-07-14 11:14:00,508 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/830631b8ca957fb6c8c33ec7870690ca 2023-07-14 11:14:00,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3/recovered.edits/9.seqid 2023-07-14 11:14:00,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testConsecutiveExports/321e8f55a8760f784fce4df282b2aee3 2023-07-14 11:14:00,509 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 11:14:00,510 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 11:14:00,511 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-14 11:14:00,522 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307142573ca0847094fa69740ce86c6f41eb7 2023-07-14 11:14:00,524 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307147f46ae25411b455f91399eb6142d2a5b 2023-07-14 11:14:00,524 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 11:14:00,528 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,530 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 11:14:00,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 11:14:00,551 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,551 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 11:14:00,551 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333240551"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:00,551 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333240551"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:00,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:14:00,557 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 830631b8ca957fb6c8c33ec7870690ca, NAME => 'testtb-testConsecutiveExports,,1689333195769.830631b8ca957fb6c8c33ec7870690ca.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 321e8f55a8760f784fce4df282b2aee3, NAME => 'testtb-testConsecutiveExports,1,1689333195769.321e8f55a8760f784fce4df282b2aee3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:14:00,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 11:14:00,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333240558"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:00,566 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 11:14:00,569 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:14:00,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 89 msec 2023-07-14 11:14:00,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 11:14:00,596 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 11:14:00,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 11:14:00,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 11:14:00,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 11:14:00,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 11:14:00,651 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 766), OpenFileDescriptor=903 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1193 (was 968) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1332 (was 2402) 2023-07-14 11:14:00,651 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-14 11:14:00,680 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=1193, ProcessCount=192, AvailableMemoryMB=1334 2023-07-14 11:14:00,681 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-14 11:14:00,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:14:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,695 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:00,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 11:14:00,697 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:00,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:14:00,702 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:00,702 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 empty. 2023-07-14 11:14:00,703 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:00,704 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:00,708 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 empty. 2023-07-14 11:14:00,709 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:00,709 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 11:14:00,765 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:00,769 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc8d6f0fd025399ccf27dd4f2fafefb3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:00,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 26ee73e54932b9233853cabee1cf5d23, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:00,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:14:00,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:00,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing cc8d6f0fd025399ccf27dd4f2fafefb3, disabling compactions & flushes 2023-07-14 11:14:00,849 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:00,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:00,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. after waiting 0 ms 2023-07-14 11:14:00,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:00,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:00,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for cc8d6f0fd025399ccf27dd4f2fafefb3: 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 26ee73e54932b9233853cabee1cf5d23, disabling compactions & flushes 2023-07-14 11:14:00,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. after waiting 0 ms 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:00,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:00,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 26ee73e54932b9233853cabee1cf5d23: 2023-07-14 11:14:00,867 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:00,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333240868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333240868"}]},"ts":"1689333240868"} 2023-07-14 11:14:00,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333240868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333240868"}]},"ts":"1689333240868"} 2023-07-14 11:14:00,881 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:00,882 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:00,882 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333240882"}]},"ts":"1689333240882"} 2023-07-14 11:14:00,884 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 11:14:00,894 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:00,895 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:00,896 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:00,896 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:00,896 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:00,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, ASSIGN}] 2023-07-14 11:14:00,899 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, ASSIGN 2023-07-14 11:14:00,899 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, ASSIGN 2023-07-14 11:14:00,900 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:14:00,900 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:14:01,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:14:01,051 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:01,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=26ee73e54932b9233853cabee1cf5d23, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333241056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333241056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333241056"}]},"ts":"1689333241056"} 2023-07-14 11:14:01,057 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cc8d6f0fd025399ccf27dd4f2fafefb3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,057 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333241057"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333241057"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333241057"}]},"ts":"1689333241057"} 2023-07-14 11:14:01,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 26ee73e54932b9233853cabee1cf5d23, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:01,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure cc8d6f0fd025399ccf27dd4f2fafefb3, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:01,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:01,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26ee73e54932b9233853cabee1cf5d23, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:14:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. service=AccessControlService 2023-07-14 11:14:01,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc8d6f0fd025399ccf27dd4f2fafefb3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:14:01,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. service=AccessControlService 2023-07-14 11:14:01,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,222 INFO [StoreOpener-26ee73e54932b9233853cabee1cf5d23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,224 INFO [StoreOpener-cc8d6f0fd025399ccf27dd4f2fafefb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,224 DEBUG [StoreOpener-26ee73e54932b9233853cabee1cf5d23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf 2023-07-14 11:14:01,224 DEBUG [StoreOpener-26ee73e54932b9233853cabee1cf5d23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf 2023-07-14 11:14:01,225 DEBUG [StoreOpener-cc8d6f0fd025399ccf27dd4f2fafefb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf 2023-07-14 11:14:01,225 INFO [StoreOpener-26ee73e54932b9233853cabee1cf5d23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26ee73e54932b9233853cabee1cf5d23 columnFamilyName cf 2023-07-14 11:14:01,226 DEBUG [StoreOpener-cc8d6f0fd025399ccf27dd4f2fafefb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf 2023-07-14 11:14:01,226 INFO [StoreOpener-cc8d6f0fd025399ccf27dd4f2fafefb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc8d6f0fd025399ccf27dd4f2fafefb3 columnFamilyName cf 2023-07-14 11:14:01,239 INFO [StoreOpener-26ee73e54932b9233853cabee1cf5d23-1] regionserver.HStore(310): Store=26ee73e54932b9233853cabee1cf5d23/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:01,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:01,246 INFO [StoreOpener-cc8d6f0fd025399ccf27dd4f2fafefb3-1] regionserver.HStore(310): Store=cc8d6f0fd025399ccf27dd4f2fafefb3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:01,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:01,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 26ee73e54932b9233853cabee1cf5d23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68876250, jitterRate=0.026336103677749634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:01,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 26ee73e54932b9233853cabee1cf5d23: 2023-07-14 11:14:01,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23., pid=60, masterSystemTime=1689333241213 2023-07-14 11:14:01,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:01,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:01,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=26ee73e54932b9233853cabee1cf5d23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333241250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333241250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333241250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333241250"}]},"ts":"1689333241250"} 2023-07-14 11:14:01,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 11:14:01,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 26ee73e54932b9233853cabee1cf5d23, server=jenkins-hbase9.apache.org,45261,1689333142675 in 194 msec 2023-07-14 11:14:01,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:01,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, ASSIGN in 359 msec 2023-07-14 11:14:01,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:01,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cc8d6f0fd025399ccf27dd4f2fafefb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61758063, jitterRate=-0.07973314821720123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:01,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cc8d6f0fd025399ccf27dd4f2fafefb3: 2023-07-14 11:14:01,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3., pid=61, masterSystemTime=1689333241218 2023-07-14 11:14:01,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,275 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cc8d6f0fd025399ccf27dd4f2fafefb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333241275"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333241275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333241275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333241275"}]},"ts":"1689333241275"} 2023-07-14 11:14:01,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 11:14:01,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure cc8d6f0fd025399ccf27dd4f2fafefb3, server=jenkins-hbase9.apache.org,45073,1689333142586 in 212 msec 2023-07-14 11:14:01,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-14 11:14:01,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, ASSIGN in 383 msec 2023-07-14 11:14:01,287 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:01,287 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333241287"}]},"ts":"1689333241287"} 2023-07-14 11:14:01,289 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 11:14:01,292 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:01,292 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 11:14:01,294 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:14:01,296 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:01,297 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:01,297 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:01,297 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:01,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 616 msec 2023-07-14 11:14:01,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:14:01,301 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 11:14:01,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:01,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:01,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:01,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:01,308 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,308 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,311 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:01,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:01,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333241342 (current time:1689333241342). 2023-07-14 11:14:01,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:01,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x1daa50f6 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:01,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ec582d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:01,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:01,389 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:01,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1daa50f6 to 127.0.0.1:51121 2023-07-14 11:14:01,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:01,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x4b3ad1fb to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:01,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55ff291f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:01,402 DEBUG [hconnection-0x2cd86142-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:01,404 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:01,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:01,410 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b3ad1fb to 127.0.0.1:51121 2023-07-14 11:14:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:14:01,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:01,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:01,424 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:01,424 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689333841424 2023-07-14 11:14:01,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:01,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,425 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:01,425 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:01,427 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:01,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:01,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-14 11:14:01,430 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:01,435 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689333841435 2023-07-14 11:14:01,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,464 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:14:01,464 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:01,466 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 11:14:01,466 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 11:14:01,467 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,467 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,468 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,468 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,468 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,469 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,469 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,469 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,470 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,470 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:14:01,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:01,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:01,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,473 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:01,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,473 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:01,473 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:01,475 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:01,475 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:01,473 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:01,475 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:01,475 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:01,475 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:01,476 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:01,476 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:01,476 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:01,480 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,480 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,481 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,482 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,482 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,482 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:01,482 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,482 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,482 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,486 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,487 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:01,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:01,489 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 11:14:01,489 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:01,491 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:01,491 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:01,491 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,491 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:01,491 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:01,492 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:01,492 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:01,492 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,492 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. started... 2023-07-14 11:14:01,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,494 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:01,494 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26ee73e54932b9233853cabee1cf5d23: 2023-07-14 11:14:01,495 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,495 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:01,495 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:01,500 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:01,500 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:01,500 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:01,500 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,501 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:01,504 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,504 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:01,507 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,507 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. started... 2023-07-14 11:14:01,508 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc8d6f0fd025399ccf27dd4f2fafefb3: 2023-07-14 11:14:01,508 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,508 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:01,508 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:01,527 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:01,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:01,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:01,529 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:01,538 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. completed. 2023-07-14 11:14:01,538 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:01,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:01,538 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:01,539 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,539 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:01,539 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:01,541 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:01,541 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,541 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:01,541 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,555 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. completed. 2023-07-14 11:14:01,555 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:01,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:01,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:01,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:01,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,558 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:01,558 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,558 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:01,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:01,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 11:14:01,561 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:14:01,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 11:14:01,568 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 11:14:01,568 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:01,569 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:01,569 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,569 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:01,571 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,574 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,575 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,576 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,579 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,580 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,580 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,592 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,592 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,592 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,592 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,592 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,597 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,597 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,608 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,608 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,609 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,609 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,609 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:01,610 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:01,611 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,611 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:01,611 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:01,611 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,611 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:14:01,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:01,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:01,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:01,731 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:02,030 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:14:02,031 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:02,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:02,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:02,033 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:02,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 11:14:02,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,346 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689333241425Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689333242038 (+613 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333242038Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333242038Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333242059 (+21 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333242162 (+103 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689333242345 (+183 ms) 2023-07-14 11:14:02,350 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:02,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 923 msec 2023-07-14 11:14:02,533 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:02,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:02,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:02,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:02,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45261] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:02,564 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,564 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:02,564 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:02,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:02,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333242580 (current time:1689333242580). 2023-07-14 11:14:02,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x5214a4b6 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@899e84c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:02,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:02,626 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:02,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5214a4b6 to 127.0.0.1:51121 2023-07-14 11:14:02,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:02,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x7f5260c2 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:02,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8144a8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:02,666 DEBUG [hconnection-0x4f08184c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:02,671 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:02,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:02,681 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:02,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f5260c2 to 127.0.0.1:51121 2023-07-14 11:14:02,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:02,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:14:02,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:02,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:02,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:02,698 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:02,699 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689333842699 2023-07-14 11:14:02,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:02,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,700 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:02,700 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:02,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:02,703 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:02,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 13 msec 2023-07-14 11:14:02,708 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:02,709 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689333842709 2023-07-14 11:14:02,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,761 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:14:02,761 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:02,763 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 11:14:02,763 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 11:14:02,764 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,764 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,765 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:02,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:02,765 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:02,765 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:02,765 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:02,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:02,766 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,766 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,766 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,766 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:02,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:02,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:02,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,770 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:02,770 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:02,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,772 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:02,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:02,774 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:02,776 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:02,781 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,781 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:02,782 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:02,783 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,783 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:02,783 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,783 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70640865[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:02,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:02,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70640865[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:02,788 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 11:14:02,788 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:02,790 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:02,790 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:02,791 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:02,791 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:02,790 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:02,791 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:02,791 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:02,791 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:02,791 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. started... 2023-07-14 11:14:02,791 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc8d6f0fd025399ccf27dd4f2fafefb3 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 11:14:02,794 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:02,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:02,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:02,795 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:02,795 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:02,795 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:02,801 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:02,801 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:02,801 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:02,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:02,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:02,802 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:02,819 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:02,819 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. started... 2023-07-14 11:14:02,820 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 26ee73e54932b9233853cabee1cf5d23 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 11:14:03,002 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:03,005 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:03,294 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1 2023-07-14 11:14:03,306 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:03,307 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:03,342 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/.tmp/cf/09c64ed283294bd291ce078ebd0c8156 2023-07-14 11:14:03,346 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6 2023-07-14 11:14:03,351 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/.tmp/cf/09c64ed283294bd291ce078ebd0c8156 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156 2023-07-14 11:14:03,360 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156, entries=5, sequenceid=6, filesize=5.8 K 2023-07-14 11:14:03,362 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for cc8d6f0fd025399ccf27dd4f2fafefb3 in 571ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:03,385 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc8d6f0fd025399ccf27dd4f2fafefb3: 2023-07-14 11:14:03,385 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,385 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:03,385 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156] hfiles 2023-07-14 11:14:03,385 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,454 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/.tmp/cf/eb06f473d3eb49f7932781b8e1477c3d 2023-07-14 11:14:03,463 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/.tmp/cf/eb06f473d3eb49f7932781b8e1477c3d as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d 2023-07-14 11:14:03,469 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d, entries=45, sequenceid=6, filesize=13.2 K 2023-07-14 11:14:03,470 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 26ee73e54932b9233853cabee1cf5d23 in 650ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:03,471 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26ee73e54932b9233853cabee1cf5d23: 2023-07-14 11:14:03,471 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,471 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:03,471 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d] hfiles 2023-07-14 11:14:03,471 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,524 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. completed. 2023-07-14 11:14:03,524 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:03,524 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:03,525 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:03,525 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,525 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:03,525 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:03,527 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:03,527 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:03,527 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:03,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:03,527 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:03,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:03,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:14:03,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 11:14:03,567 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. completed. 2023-07-14 11:14:03,568 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:03,570 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:03,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 11:14:03,578 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 11:14:03,578 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:03,578 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:03,578 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,578 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:03,594 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,594 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,594 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,594 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:03,594 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:03,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,596 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,596 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,597 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,597 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,598 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:03,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,602 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,602 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,603 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:03,607 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:03,607 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:03,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:03,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1] mob files 2023-07-14 11:14:03,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6 2023-07-14 11:14:03,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1 2023-07-14 11:14:03,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:03,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:03,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,808 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:03,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:03,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:03,811 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 11:14:03,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 11:14:03,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,924 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:03,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689333242699Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689333243682 (+983 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689333243682Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689333243682Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689333243709 (+27 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689333243794 (+85 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689333243924 (+130 ms) 2023-07-14 11:14:03,928 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:03,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2280 sec 2023-07-14 11:14:04,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0004_000001 (auth:SIMPLE) 2023-07-14 11:14:04,811 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:04,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:04,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:04,855 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:04,860 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:04,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33095] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:04,868 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:04,876 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:04,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:04,877 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:04,896 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:04,896 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45261] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:04,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:14:04,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:04,904 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:04,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 11:14:04,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:04,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:04,909 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:04,909 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:04,910 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 empty. 2023-07-14 11:14:04,910 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 empty. 2023-07-14 11:14:04,911 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:04,911 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:04,911 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 11:14:04,997 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:04,999 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f3b0eee52f699a355bdb217aa8c960b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:05,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91489c9211592ad5415f26af5ee89f19, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:05,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:05,092 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:05,092 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 91489c9211592ad5415f26af5ee89f19, disabling compactions & flushes 2023-07-14 11:14:05,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. after waiting 0 ms 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 91489c9211592ad5415f26af5ee89f19: 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f3b0eee52f699a355bdb217aa8c960b0, disabling compactions & flushes 2023-07-14 11:14:05,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. after waiting 0 ms 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,093 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,093 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f3b0eee52f699a355bdb217aa8c960b0: 2023-07-14 11:14:05,100 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:05,101 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333245101"}]},"ts":"1689333245101"} 2023-07-14 11:14:05,101 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333245101"}]},"ts":"1689333245101"} 2023-07-14 11:14:05,109 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:05,110 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:05,110 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333245110"}]},"ts":"1689333245110"} 2023-07-14 11:14:05,112 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 11:14:05,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:05,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:05,233 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:05,233 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:05,233 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:05,233 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:05,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, ASSIGN}] 2023-07-14 11:14:05,236 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, ASSIGN 2023-07-14 11:14:05,236 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, ASSIGN 2023-07-14 11:14:05,237 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:14:05,237 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:14:05,387 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:05,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=91489c9211592ad5415f26af5ee89f19, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:05,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f3b0eee52f699a355bdb217aa8c960b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:05,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333245397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333245397"}]},"ts":"1689333245397"} 2023-07-14 11:14:05,397 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333245397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333245397"}]},"ts":"1689333245397"} 2023-07-14 11:14:05,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 91489c9211592ad5415f26af5ee89f19, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:05,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f3b0eee52f699a355bdb217aa8c960b0, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:05,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:05,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3b0eee52f699a355bdb217aa8c960b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 11:14:05,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. service=AccessControlService 2023-07-14 11:14:05,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:05,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:05,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91489c9211592ad5415f26af5ee89f19, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 11:14:05,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. service=AccessControlService 2023-07-14 11:14:05,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:05,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:05,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,565 INFO [StoreOpener-f3b0eee52f699a355bdb217aa8c960b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,565 INFO [StoreOpener-91489c9211592ad5415f26af5ee89f19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,568 DEBUG [StoreOpener-91489c9211592ad5415f26af5ee89f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf 2023-07-14 11:14:05,568 DEBUG [StoreOpener-f3b0eee52f699a355bdb217aa8c960b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf 2023-07-14 11:14:05,568 DEBUG [StoreOpener-f3b0eee52f699a355bdb217aa8c960b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf 2023-07-14 11:14:05,568 DEBUG [StoreOpener-91489c9211592ad5415f26af5ee89f19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf 2023-07-14 11:14:05,568 INFO [StoreOpener-f3b0eee52f699a355bdb217aa8c960b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3b0eee52f699a355bdb217aa8c960b0 columnFamilyName cf 2023-07-14 11:14:05,568 INFO [StoreOpener-91489c9211592ad5415f26af5ee89f19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91489c9211592ad5415f26af5ee89f19 columnFamilyName cf 2023-07-14 11:14:05,569 INFO [StoreOpener-f3b0eee52f699a355bdb217aa8c960b0-1] regionserver.HStore(310): Store=f3b0eee52f699a355bdb217aa8c960b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:05,569 INFO [StoreOpener-91489c9211592ad5415f26af5ee89f19-1] regionserver.HStore(310): Store=91489c9211592ad5415f26af5ee89f19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:05,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:05,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:05,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:05,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:05,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f3b0eee52f699a355bdb217aa8c960b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64447713, jitterRate=-0.039654240012168884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:05,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f3b0eee52f699a355bdb217aa8c960b0: 2023-07-14 11:14:05,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 91489c9211592ad5415f26af5ee89f19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60633112, jitterRate=-0.09649622440338135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:05,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 91489c9211592ad5415f26af5ee89f19: 2023-07-14 11:14:05,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0., pid=70, masterSystemTime=1689333245557 2023-07-14 11:14:05,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19., pid=69, masterSystemTime=1689333245557 2023-07-14 11:14:05,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:05,589 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f3b0eee52f699a355bdb217aa8c960b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:05,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245589"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333245589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333245589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333245589"}]},"ts":"1689333245589"} 2023-07-14 11:14:05,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:05,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=91489c9211592ad5415f26af5ee89f19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:05,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333245591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333245591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333245591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333245591"}]},"ts":"1689333245591"} 2023-07-14 11:14:05,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-14 11:14:05,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f3b0eee52f699a355bdb217aa8c960b0, server=jenkins-hbase9.apache.org,45261,1689333142675 in 187 msec 2023-07-14 11:14:05,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-14 11:14:05,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 91489c9211592ad5415f26af5ee89f19, server=jenkins-hbase9.apache.org,45073,1689333142586 in 191 msec 2023-07-14 11:14:05,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, ASSIGN in 364 msec 2023-07-14 11:14:05,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-14 11:14:05,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, ASSIGN in 365 msec 2023-07-14 11:14:05,601 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:05,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333245601"}]},"ts":"1689333245601"} 2023-07-14 11:14:05,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 11:14:05,633 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:05,633 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 11:14:05,635 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 11:14:05,662 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:05,662 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:05,662 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:05,662 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:05,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:05,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 801 msec 2023-07-14 11:14:06,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:06,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:06,013 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 11:14:06,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:06,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19], force=true 2023-07-14 11:14:06,149 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19], force=true 2023-07-14 11:14:06,149 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19], force=true 2023-07-14 11:14:06,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19], force=true 2023-07-14 11:14:06,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:06,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, UNASSIGN}] 2023-07-14 11:14:06,194 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, UNASSIGN 2023-07-14 11:14:06,198 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, UNASSIGN 2023-07-14 11:14:06,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=91489c9211592ad5415f26af5ee89f19, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:06,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333246199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333246199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333246199"}]},"ts":"1689333246199"} 2023-07-14 11:14:06,200 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f3b0eee52f699a355bdb217aa8c960b0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:06,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333246200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333246200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333246200"}]},"ts":"1689333246200"} 2023-07-14 11:14:06,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 91489c9211592ad5415f26af5ee89f19, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:06,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure f3b0eee52f699a355bdb217aa8c960b0, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:06,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:06,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 91489c9211592ad5415f26af5ee89f19, disabling compactions & flushes 2023-07-14 11:14:06,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. after waiting 0 ms 2023-07-14 11:14:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:06,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 91489c9211592ad5415f26af5ee89f19 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 11:14:06,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:06,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f3b0eee52f699a355bdb217aa8c960b0, disabling compactions & flushes 2023-07-14 11:14:06,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:06,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:06,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. after waiting 0 ms 2023-07-14 11:14:06,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:06,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing f3b0eee52f699a355bdb217aa8c960b0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 11:14:06,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:06,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/.tmp/cf/05882b54ab7a404a90130be5ec339010 2023-07-14 11:14:06,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/.tmp/cf/ddfe3458c9b942c1ae2d82bf5b15f647 2023-07-14 11:14:06,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/.tmp/cf/05882b54ab7a404a90130be5ec339010 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010 2023-07-14 11:14:06,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 11:14:06,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 91489c9211592ad5415f26af5ee89f19 in 143ms, sequenceid=5, compaction requested=false 2023-07-14 11:14:06,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 11:14:06,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/.tmp/cf/ddfe3458c9b942c1ae2d82bf5b15f647 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647 2023-07-14 11:14:06,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 11:14:06,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f3b0eee52f699a355bdb217aa8c960b0 in 175ms, sequenceid=5, compaction requested=false 2023-07-14 11:14:06,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 11:14:06,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:06,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19. 2023-07-14 11:14:06,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 91489c9211592ad5415f26af5ee89f19: 2023-07-14 11:14:06,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:06,571 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=91489c9211592ad5415f26af5ee89f19, regionState=CLOSED 2023-07-14 11:14:06,571 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333246571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333246571"}]},"ts":"1689333246571"} 2023-07-14 11:14:06,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 11:14:06,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:06,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-14 11:14:06,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 91489c9211592ad5415f26af5ee89f19, server=jenkins-hbase9.apache.org,45073,1689333142586 in 371 msec 2023-07-14 11:14:06,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=91489c9211592ad5415f26af5ee89f19, UNASSIGN in 387 msec 2023-07-14 11:14:06,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0. 2023-07-14 11:14:06,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f3b0eee52f699a355bdb217aa8c960b0: 2023-07-14 11:14:06,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:06,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f3b0eee52f699a355bdb217aa8c960b0, regionState=CLOSED 2023-07-14 11:14:06,590 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333246590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333246590"}]},"ts":"1689333246590"} 2023-07-14 11:14:06,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-14 11:14:06,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure f3b0eee52f699a355bdb217aa8c960b0, server=jenkins-hbase9.apache.org,45261,1689333142675 in 391 msec 2023-07-14 11:14:06,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 11:14:06,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3b0eee52f699a355bdb217aa8c960b0, UNASSIGN in 480 msec 2023-07-14 11:14:06,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:06,878 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 11:14:06,880 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244899.f3b0eee52f699a355bdb217aa8c960b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:06,880 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333244899.91489c9211592ad5415f26af5ee89f19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:06,880 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:06,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, ASSIGN}] 2023-07-14 11:14:06,965 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, ASSIGN 2023-07-14 11:14:06,966 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:14:07,116 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:14:07,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a3c4d988154ad4b271abb4309e6b6908, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:07,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333247119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333247119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333247119"}]},"ts":"1689333247119"} 2023-07-14 11:14:07,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a3c4d988154ad4b271abb4309e6b6908, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:07,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:07,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3c4d988154ad4b271abb4309e6b6908, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. service=AccessControlService 2023-07-14 11:14:07,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/.regioninfo 2023-07-14 11:14:07,369 INFO [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,371 DEBUG [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf 2023-07-14 11:14:07,371 DEBUG [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf 2023-07-14 11:14:07,372 INFO [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3c4d988154ad4b271abb4309e6b6908 columnFamilyName cf 2023-07-14 11:14:07,428 DEBUG [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] regionserver.HStore(539): loaded hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/05882b54ab7a404a90130be5ec339010.91489c9211592ad5415f26af5ee89f19->hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010-top 2023-07-14 11:14:07,439 DEBUG [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] regionserver.HStore(539): loaded hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/ddfe3458c9b942c1ae2d82bf5b15f647.f3b0eee52f699a355bdb217aa8c960b0->hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647-top 2023-07-14 11:14:07,439 INFO [StoreOpener-a3c4d988154ad4b271abb4309e6b6908-1] regionserver.HStore(310): Store=a3c4d988154ad4b271abb4309e6b6908/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:07,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:07,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a3c4d988154ad4b271abb4309e6b6908; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65420385, jitterRate=-0.025160297751426697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:07,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a3c4d988154ad4b271abb4309e6b6908: 2023-07-14 11:14:07,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908., pid=77, masterSystemTime=1689333247273 2023-07-14 11:14:07,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.,because compaction is disabled. 2023-07-14 11:14:07,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:07,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:07,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a3c4d988154ad4b271abb4309e6b6908, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:07,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333247464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333247464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333247464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333247464"}]},"ts":"1689333247464"} 2023-07-14 11:14:07,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 11:14:07,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a3c4d988154ad4b271abb4309e6b6908, server=jenkins-hbase9.apache.org,45261,1689333142675 in 345 msec 2023-07-14 11:14:07,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 11:14:07,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, ASSIGN in 504 msec 2023-07-14 11:14:07,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f3b0eee52f699a355bdb217aa8c960b0, 91489c9211592ad5415f26af5ee89f19], force=true in 1.3420 sec 2023-07-14 11:14:08,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:08,271 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 11:14:08,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:08,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333248272 (current time:1689333248272). 2023-07-14 11:14:08,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:08,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x1f8e396a to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14fee8c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:08,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:08,331 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f8e396a to 127.0.0.1:51121 2023-07-14 11:14:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x58c49679 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@366fb162, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:08,390 DEBUG [hconnection-0x55b4ef9c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:08,399 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:08,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:08,409 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:08,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58c49679 to 127.0.0.1:51121 2023-07-14 11:14:08,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:08,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 11:14:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:08,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:08,415 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:08,416 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689333848416 2023-07-14 11:14:08,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:08,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,421 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:08,423 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:08,423 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:08,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:08,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-14 11:14:08,432 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:08,433 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689333848433 2023-07-14 11:14:08,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,490 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 11:14:08,491 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:08,492 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 11:14:08,492 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 11:14:08,493 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,493 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,494 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,494 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,494 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,494 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,495 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,495 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:08,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:08,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,506 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:08,506 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:08,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,510 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:08,527 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:08,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,525 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:08,527 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:08,527 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:08,527 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:08,527 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:08,527 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:08,529 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:08,529 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:08,529 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:08,530 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:08,531 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:08,531 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:08,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:08,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:08,531 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:08,532 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,532 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:08,533 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,533 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,533 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:08,533 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:08,534 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,534 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:08,534 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,534 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:08,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 11:14:08,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea07f91[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:08,537 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 11:14:08,537 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,539 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:08,539 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:08,539 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:08,539 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,540 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:08,540 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:08,540 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:08,540 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:08,540 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:08,540 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:08,540 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. started... 2023-07-14 11:14:08,541 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3c4d988154ad4b271abb4309e6b6908: 2023-07-14 11:14:08,542 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,542 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:08,542 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/05882b54ab7a404a90130be5ec339010.91489c9211592ad5415f26af5ee89f19->hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010-top, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/ddfe3458c9b942c1ae2d82bf5b15f647.f3b0eee52f699a355bdb217aa8c960b0->hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647-top] hfiles 2023-07-14 11:14:08,542 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/05882b54ab7a404a90130be5ec339010.91489c9211592ad5415f26af5ee89f19 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,554 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/ddfe3458c9b942c1ae2d82bf5b15f647.f3b0eee52f699a355bdb217aa8c960b0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:08,555 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:08,556 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:08,556 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,556 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:08,556 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:08,556 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:08,556 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:08,649 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. completed. 2023-07-14 11:14:08,649 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:08,649 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:08,649 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:08,649 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,649 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:08,649 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:08,656 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,656 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:08,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,656 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:08,656 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:08,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:08,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:08,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:08,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:08,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:08,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 11:14:08,662 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 11:14:08,663 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:08,663 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:08,663 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,663 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:08,664 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,664 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,664 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,665 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,664 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:08,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,666 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,667 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:08,667 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:08,669 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,670 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,677 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,683 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:08,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:08,683 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,682 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:08,683 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,683 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:08,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:08,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:08,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:08,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:08,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,684 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:08,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:08,685 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,685 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:08,731 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:08,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:08,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:08,733 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:08,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:09,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 11:14:09,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:09,014 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:09,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689333248417Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333248683 (+266 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333248683Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333248696 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333248814 (+118 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689333249014 (+200 ms) 2023-07-14 11:14:09,018 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:09,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 597 msec 2023-07-14 11:14:09,033 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:09,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:09,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:09,035 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035 2023-07-14 11:14:09,035 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45973, tgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035, rawTgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:09,071 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:09,071 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1794021985_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:09,071 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 11:14:09,094 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:09,205 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,206 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,206 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,207 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,207 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,207 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,208 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,298 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-9046517861426374433.jar 2023-07-14 11:14:09,299 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,299 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,299 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,300 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,300 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,300 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:09,301 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:09,302 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:09,302 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:09,303 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:09,303 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:09,304 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:09,304 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:09,304 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:09,305 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:09,305 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:09,306 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:09,306 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:09,306 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:09,307 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:09,307 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:09,307 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:09,308 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:11,065 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:12,654 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:12,658 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 11:14:12,661 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 11:14:12,959 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:12,959 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:13,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:22,542 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:25,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:33,235 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:14:33,238 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:14:33,255 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,255 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:14:33,258 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:14:33,259 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,259 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 11:14:33,259 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 11:14:33,259 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,260 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 11:14:33,260 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333249035/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 11:14:33,280 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:33,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273285"}]},"ts":"1689333273285"} 2023-07-14 11:14:33,287 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 11:14:33,288 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 11:14:33,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, UNASSIGN}] 2023-07-14 11:14:33,292 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, UNASSIGN 2023-07-14 11:14:33,294 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a3c4d988154ad4b271abb4309e6b6908, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:33,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333273293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333273293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333273293"}]},"ts":"1689333273293"} 2023-07-14 11:14:33,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a3c4d988154ad4b271abb4309e6b6908, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:33,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:33,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:33,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a3c4d988154ad4b271abb4309e6b6908, disabling compactions & flushes 2023-07-14 11:14:33,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:33,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:33,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. after waiting 0 ms 2023-07-14 11:14:33,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:33,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 11:14:33,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908. 2023-07-14 11:14:33,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a3c4d988154ad4b271abb4309e6b6908: 2023-07-14 11:14:33,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:33,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a3c4d988154ad4b271abb4309e6b6908, regionState=CLOSED 2023-07-14 11:14:33,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333273469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273469"}]},"ts":"1689333273469"} 2023-07-14 11:14:33,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 11:14:33,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a3c4d988154ad4b271abb4309e6b6908, server=jenkins-hbase9.apache.org,45261,1689333142675 in 175 msec 2023-07-14 11:14:33,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 11:14:33,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3c4d988154ad4b271abb4309e6b6908, UNASSIGN in 189 msec 2023-07-14 11:14:33,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273481"}]},"ts":"1689333273481"} 2023-07-14 11:14:33,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 11:14:33,485 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 11:14:33,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 207 msec 2023-07-14 11:14:33,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:33,588 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 11:14:33,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,593 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,595 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,596 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,600 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,600 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,600 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,601 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,602 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:33,602 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,602 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,603 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,604 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,604 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 11:14:33,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,607 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/recovered.edits] 2023-07-14 11:14:33,607 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/recovered.edits] 2023-07-14 11:14:33,608 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/recovered.edits] 2023-07-14 11:14:33,616 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/cf/ddfe3458c9b942c1ae2d82bf5b15f647 2023-07-14 11:14:33,617 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/cf/05882b54ab7a404a90130be5ec339010 2023-07-14 11:14:33,618 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/05882b54ab7a404a90130be5ec339010.91489c9211592ad5415f26af5ee89f19 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/05882b54ab7a404a90130be5ec339010.91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:33,619 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/ddfe3458c9b942c1ae2d82bf5b15f647.f3b0eee52f699a355bdb217aa8c960b0 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/cf/ddfe3458c9b942c1ae2d82bf5b15f647.f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:33,620 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/recovered.edits/8.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0/recovered.edits/8.seqid 2023-07-14 11:14:33,621 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3b0eee52f699a355bdb217aa8c960b0 2023-07-14 11:14:33,622 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/recovered.edits/8.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19/recovered.edits/8.seqid 2023-07-14 11:14:33,622 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/91489c9211592ad5415f26af5ee89f19 2023-07-14 11:14:33,625 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/recovered.edits/12.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908/recovered.edits/12.seqid 2023-07-14 11:14:33,625 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3c4d988154ad4b271abb4309e6b6908 2023-07-14 11:14:33,625 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 11:14:33,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,630 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 11:14:33,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 11:14:33,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 11:14:33,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333273635"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,639 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 11:14:33,639 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a3c4d988154ad4b271abb4309e6b6908, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333244900.a3c4d988154ad4b271abb4309e6b6908.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 11:14:33,639 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 11:14:33,639 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333273639"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,641 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 11:14:33,643 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 54 msec 2023-07-14 11:14:33,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 11:14:33,707 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 11:14:33,708 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:33,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273720"}]},"ts":"1689333273720"} 2023-07-14 11:14:33,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 11:14:33,726 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 11:14:33,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, UNASSIGN}] 2023-07-14 11:14:33,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, UNASSIGN 2023-07-14 11:14:33,732 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, UNASSIGN 2023-07-14 11:14:33,733 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cc8d6f0fd025399ccf27dd4f2fafefb3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:33,733 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333273733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333273733"}]},"ts":"1689333273733"} 2023-07-14 11:14:33,733 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=26ee73e54932b9233853cabee1cf5d23, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:33,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333273733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333273733"}]},"ts":"1689333273733"} 2023-07-14 11:14:33,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure cc8d6f0fd025399ccf27dd4f2fafefb3, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:33,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 26ee73e54932b9233853cabee1cf5d23, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:33,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:33,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:33,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cc8d6f0fd025399ccf27dd4f2fafefb3, disabling compactions & flushes 2023-07-14 11:14:33,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:33,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:33,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. after waiting 0 ms 2023-07-14 11:14:33,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:33,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:33,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 26ee73e54932b9233853cabee1cf5d23, disabling compactions & flushes 2023-07-14 11:14:33,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:33,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:33,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. after waiting 0 ms 2023-07-14 11:14:33,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:33,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:33,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:33,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3. 2023-07-14 11:14:33,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cc8d6f0fd025399ccf27dd4f2fafefb3: 2023-07-14 11:14:33,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23. 2023-07-14 11:14:33,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 26ee73e54932b9233853cabee1cf5d23: 2023-07-14 11:14:33,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:33,910 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cc8d6f0fd025399ccf27dd4f2fafefb3, regionState=CLOSED 2023-07-14 11:14:33,910 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273910"}]},"ts":"1689333273910"} 2023-07-14 11:14:33,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:33,912 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=26ee73e54932b9233853cabee1cf5d23, regionState=CLOSED 2023-07-14 11:14:33,912 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273912"}]},"ts":"1689333273912"} 2023-07-14 11:14:33,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 11:14:33,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure cc8d6f0fd025399ccf27dd4f2fafefb3, server=jenkins-hbase9.apache.org,45073,1689333142586 in 174 msec 2023-07-14 11:14:33,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cc8d6f0fd025399ccf27dd4f2fafefb3, UNASSIGN in 188 msec 2023-07-14 11:14:33,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 11:14:33,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 26ee73e54932b9233853cabee1cf5d23, server=jenkins-hbase9.apache.org,45261,1689333142675 in 175 msec 2023-07-14 11:14:33,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-14 11:14:33,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26ee73e54932b9233853cabee1cf5d23, UNASSIGN in 192 msec 2023-07-14 11:14:33,930 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273930"}]},"ts":"1689333273930"} 2023-07-14 11:14:33,932 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 11:14:33,935 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 11:14:33,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 227 msec 2023-07-14 11:14:34,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:34,023 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 11:14:34,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,027 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,028 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,031 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,033 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,033 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,033 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,033 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:34,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:34,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:34,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:34,034 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:34,034 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:34,036 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/recovered.edits] 2023-07-14 11:14:34,036 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/recovered.edits] 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,041 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,042 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 11:14:34,045 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/cf/09c64ed283294bd291ce078ebd0c8156 2023-07-14 11:14:34,046 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/cf/eb06f473d3eb49f7932781b8e1477c3d 2023-07-14 11:14:34,055 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23/recovered.edits/9.seqid 2023-07-14 11:14:34,056 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3/recovered.edits/9.seqid 2023-07-14 11:14:34,056 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26ee73e54932b9233853cabee1cf5d23 2023-07-14 11:14:34,056 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cc8d6f0fd025399ccf27dd4f2fafefb3 2023-07-14 11:14:34,056 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 11:14:34,057 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 11:14:34,058 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-14 11:14:34,062 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071495ab4738869e4ad796ee96bff9adbfa6 2023-07-14 11:14:34,063 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230714b9b83d19d8c94464a928f08d877e51b1 2023-07-14 11:14:34,064 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 11:14:34,066 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,069 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 11:14:34,073 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 11:14:34,074 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,074 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 11:14:34,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333274074"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:34,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333274074"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:34,079 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:14:34,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cc8d6f0fd025399ccf27dd4f2fafefb3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333240683.cc8d6f0fd025399ccf27dd4f2fafefb3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 26ee73e54932b9233853cabee1cf5d23, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333240683.26ee73e54932b9233853cabee1cf5d23.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:14:34,079 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 11:14:34,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333274079"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:34,081 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 11:14:34,083 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 59 msec 2023-07-14 11:14:34,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 11:14:34,147 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 11:14:34,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 11:14:34,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 11:14:34,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 11:14:34,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:34,208 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 743) Potentially hanging thread: hconnection-0x234760f4-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1996778432_1 at /127.0.0.1:58572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:35770 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:60502 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4228 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1996778432_1 at /127.0.0.1:35756 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:36005 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x234760f4-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:58600 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1447 (was 1193) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=1090 (was 1334) 2023-07-14 11:14:34,209 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 11:14:34,238 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=1447, ProcessCount=192, AvailableMemoryMB=1091 2023-07-14 11:14:34,238 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 11:14:34,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:14:34,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:34,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:34,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 11:14:34,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:34,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,248 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,248 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,248 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c empty. 2023-07-14 11:14:34,248 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d empty. 2023-07-14 11:14:34,249 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,249 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,249 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 11:14:34,279 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:34,280 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 996f6bcbb2b4a11e5948c387cccc693d, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:34,281 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fcb1f4772b2e176c98acfa337b04b6c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:34,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,358 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 996f6bcbb2b4a11e5948c387cccc693d, disabling compactions & flushes 2023-07-14 11:14:34,359 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. after waiting 0 ms 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,359 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 996f6bcbb2b4a11e5948c387cccc693d: 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8fcb1f4772b2e176c98acfa337b04b6c, disabling compactions & flushes 2023-07-14 11:14:34,359 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. after waiting 0 ms 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,359 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,359 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8fcb1f4772b2e176c98acfa337b04b6c: 2023-07-14 11:14:34,365 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:34,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333274368"}]},"ts":"1689333274368"} 2023-07-14 11:14:34,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333274368"}]},"ts":"1689333274368"} 2023-07-14 11:14:34,371 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:34,374 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:34,374 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333274374"}]},"ts":"1689333274374"} 2023-07-14 11:14:34,376 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 11:14:34,379 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:34,381 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:34,381 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:34,381 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:34,381 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:34,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, ASSIGN}] 2023-07-14 11:14:34,385 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, ASSIGN 2023-07-14 11:14:34,386 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, ASSIGN 2023-07-14 11:14:34,387 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45073,1689333142586; forceNewPlan=false, retain=false 2023-07-14 11:14:34,388 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:14:34,537 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:34,544 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8fcb1f4772b2e176c98acfa337b04b6c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:34,545 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333274544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333274544"}]},"ts":"1689333274544"} 2023-07-14 11:14:34,545 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=996f6bcbb2b4a11e5948c387cccc693d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:34,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333274545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333274545"}]},"ts":"1689333274545"} 2023-07-14 11:14:34,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 8fcb1f4772b2e176c98acfa337b04b6c, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:34,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 996f6bcbb2b4a11e5948c387cccc693d, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:34,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fcb1f4772b2e176c98acfa337b04b6c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. service=AccessControlService 2023-07-14 11:14:34,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,717 INFO [StoreOpener-8fcb1f4772b2e176c98acfa337b04b6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 996f6bcbb2b4a11e5948c387cccc693d, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:14:34,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. service=AccessControlService 2023-07-14 11:14:34,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:34,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,724 DEBUG [StoreOpener-8fcb1f4772b2e176c98acfa337b04b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf 2023-07-14 11:14:34,724 DEBUG [StoreOpener-8fcb1f4772b2e176c98acfa337b04b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf 2023-07-14 11:14:34,724 INFO [StoreOpener-8fcb1f4772b2e176c98acfa337b04b6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fcb1f4772b2e176c98acfa337b04b6c columnFamilyName cf 2023-07-14 11:14:34,726 INFO [StoreOpener-8fcb1f4772b2e176c98acfa337b04b6c-1] regionserver.HStore(310): Store=8fcb1f4772b2e176c98acfa337b04b6c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:34,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,731 INFO [StoreOpener-996f6bcbb2b4a11e5948c387cccc693d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,735 DEBUG [StoreOpener-996f6bcbb2b4a11e5948c387cccc693d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf 2023-07-14 11:14:34,735 DEBUG [StoreOpener-996f6bcbb2b4a11e5948c387cccc693d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf 2023-07-14 11:14:34,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:34,736 INFO [StoreOpener-996f6bcbb2b4a11e5948c387cccc693d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 996f6bcbb2b4a11e5948c387cccc693d columnFamilyName cf 2023-07-14 11:14:34,738 INFO [StoreOpener-996f6bcbb2b4a11e5948c387cccc693d-1] regionserver.HStore(310): Store=996f6bcbb2b4a11e5948c387cccc693d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:34,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:34,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8fcb1f4772b2e176c98acfa337b04b6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71161379, jitterRate=0.060387179255485535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:34,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8fcb1f4772b2e176c98acfa337b04b6c: 2023-07-14 11:14:34,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c., pid=93, masterSystemTime=1689333274702 2023-07-14 11:14:34,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:34,749 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8fcb1f4772b2e176c98acfa337b04b6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:34,749 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333274749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333274749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333274749"}]},"ts":"1689333274749"} 2023-07-14 11:14:34,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:34,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 11:14:34,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 8fcb1f4772b2e176c98acfa337b04b6c, server=jenkins-hbase9.apache.org,45261,1689333142675 in 203 msec 2023-07-14 11:14:34,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, ASSIGN in 375 msec 2023-07-14 11:14:34,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:34,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 996f6bcbb2b4a11e5948c387cccc693d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67102667, jitterRate=-9.234249591827393E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:34,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 996f6bcbb2b4a11e5948c387cccc693d: 2023-07-14 11:14:34,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d., pid=94, masterSystemTime=1689333274718 2023-07-14 11:14:34,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,765 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=996f6bcbb2b4a11e5948c387cccc693d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:34,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333274765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333274765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333274765"}]},"ts":"1689333274765"} 2023-07-14 11:14:34,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 11:14:34,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 996f6bcbb2b4a11e5948c387cccc693d, server=jenkins-hbase9.apache.org,45073,1689333142586 in 212 msec 2023-07-14 11:14:34,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-14 11:14:34,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, ASSIGN in 388 msec 2023-07-14 11:14:34,779 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:34,779 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333274779"}]},"ts":"1689333274779"} 2023-07-14 11:14:34,781 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 11:14:34,787 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:34,788 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 11:14:34,790 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:34,791 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,791 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,791 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,791 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 555 msec 2023-07-14 11:14:34,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,850 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 11:14:34,858 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:34,859 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:34,860 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:34,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:34,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333274894 (current time:1689333274894). 2023-07-14 11:14:34,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:34,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x4daf5272 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:34,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27bc1d0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:34,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,936 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4daf5272 to 127.0.0.1:51121 2023-07-14 11:14:34,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:34,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x57dbd3ae to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:34,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d027e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:34,986 DEBUG [hconnection-0x2743028e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,990 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,997 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57dbd3ae to 127.0.0.1:51121 2023-07-14 11:14:34,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:34,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:35,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:35,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,009 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,015 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333875015 2023-07-14 11:14:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,019 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:35,021 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,021 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:35,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-14 11:14:35,029 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,032 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333875032 2023-07-14 11:14:35,122 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,126 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 11:14:35,128 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,128 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 11:14:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,128 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:14:35,128 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:35,128 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,128 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,133 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,133 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,134 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,133 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,135 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,135 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,136 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,136 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,137 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,137 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,137 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,141 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,141 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,141 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,147 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,147 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,148 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,148 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:35,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:35,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,158 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,158 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,161 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,163 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,170 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,170 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,170 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,170 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,172 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,172 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,172 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,172 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,175 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,175 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,175 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,182 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,182 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,182 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:35,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:35,183 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:14:35,183 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,185 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,185 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,185 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:35,185 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:35,186 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:35,186 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. started... 2023-07-14 11:14:35,186 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:35,186 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:35,186 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:35,186 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. started... 2023-07-14 11:14:35,186 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 996f6bcbb2b4a11e5948c387cccc693d: 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fcb1f4772b2e176c98acfa337b04b6c: 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,188 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,188 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:35,188 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:35,190 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:35,188 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,238 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. completed. 2023-07-14 11:14:35,238 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:35,238 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,238 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,239 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,239 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,239 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:35,240 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,241 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,241 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,241 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,246 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. completed. 2023-07-14 11:14:35,246 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:35,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,246 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,246 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,246 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,246 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,246 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:35,248 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,248 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,249 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,249 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:14:35,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:14:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:35,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:14:35,262 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 11:14:35,262 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:35,262 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:35,262 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,262 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,266 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,267 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,267 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,268 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,270 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,271 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,271 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,275 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,275 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,277 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,278 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:14:35,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,328 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,330 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:35,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 11:14:35,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,370 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689333275015Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689333275290 (+275 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689333275290Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689333275290Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689333275303 (+13 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689333275326 (+23 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689333275370 (+44 ms) 2023-07-14 11:14:35,375 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 358 msec 2023-07-14 11:14:35,630 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:35,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:35,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45261] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:35,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:35,640 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:35,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333275650 (current time:1689333275650). 2023-07-14 11:14:35,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:35,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x356c8347 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:35,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a84a016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:35,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,683 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x356c8347 to 127.0.0.1:51121 2023-07-14 11:14:35,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:35,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc832a4 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:35,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2deff0c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:35,818 DEBUG [hconnection-0x2c4617a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,819 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,834 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc832a4 to 127.0.0.1:51121 2023-07-14 11:14:35,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:35,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:35,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:35,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,841 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,842 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333875841 2023-07-14 11:14:35,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,843 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:35,843 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:35,844 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-14 11:14:35,847 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,848 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333875848 2023-07-14 11:14:35,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,860 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 11:14:35,860 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,861 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 11:14:35,861 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:14:35,934 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,934 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,944 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,945 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:36,028 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,028 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,028 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,028 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,029 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,029 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:36,030 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:36,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:36,030 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:36,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,032 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:36,041 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:36,081 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,081 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:36,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:36,145 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:36,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:36,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:36,146 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:36,165 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:36,165 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,165 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,165 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:36,165 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:36,166 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,166 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:36,166 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,166 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dead17[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:36,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:36,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:36,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:36,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dead17[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:36,171 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:14:36,171 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,447 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:36,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:36,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:36,448 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:36,604 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,604 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,604 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:36,605 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:36,605 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:36,605 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:36,606 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:36,606 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. started... 2023-07-14 11:14:36,606 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. started... 2023-07-14 11:14:36,606 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,606 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:36,606 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fcb1f4772b2e176c98acfa337b04b6c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 11:14:36,606 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 996f6bcbb2b4a11e5948c387cccc693d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 11:14:36,698 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e 2023-07-14 11:14:36,701 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b 2023-07-14 11:14:36,711 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:36,711 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:36,711 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:36,814 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/.tmp/cf/754ea712cec9422da668fc2aba67717a 2023-07-14 11:14:36,817 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/.tmp/cf/e1a66b87da3a4cf78c8b3aca853b941e 2023-07-14 11:14:36,825 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/.tmp/cf/754ea712cec9422da668fc2aba67717a as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a 2023-07-14 11:14:36,829 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/.tmp/cf/e1a66b87da3a4cf78c8b3aca853b941e as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e 2023-07-14 11:14:36,831 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a, entries=3, sequenceid=6, filesize=5.4 K 2023-07-14 11:14:36,832 INFO [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 996f6bcbb2b4a11e5948c387cccc693d in 226ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:36,832 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 11:14:36,833 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 996f6bcbb2b4a11e5948c387cccc693d: 2023-07-14 11:14:36,833 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,833 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:36,833 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a] hfiles 2023-07-14 11:14:36,834 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,837 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e, entries=47, sequenceid=6, filesize=13.1 K 2023-07-14 11:14:36,838 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8fcb1f4772b2e176c98acfa337b04b6c in 232ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:36,847 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fcb1f4772b2e176c98acfa337b04b6c: 2023-07-14 11:14:36,847 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,847 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:36,847 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e] hfiles 2023-07-14 11:14:36,847 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,886 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. completed. 2023-07-14 11:14:36,886 DEBUG [rs(jenkins-hbase9.apache.org,45073,1689333142586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:36,886 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:36,886 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:36,886 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,889 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:36,889 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:36,892 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. completed. 2023-07-14 11:14:36,892 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:36,892 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:36,948 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:36,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:36,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:36,949 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 11:14:36,997 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:36,997 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:36,997 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:36,998 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:37,097 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,097 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:37,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:37,097 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:37,097 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45073,1689333142586': 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:37,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:14:37,105 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 11:14:37,105 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:37,105 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:37,105 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,105 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,188 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:37,189 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,189 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,190 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,191 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,192 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,192 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,236 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:37,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,236 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:37,236 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:37,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:37,235 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:37,236 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:37,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:37,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:37,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:37,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,238 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e] mob files 2023-07-14 11:14:37,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b 2023-07-14 11:14:37,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e 2023-07-14 11:14:37,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 11:14:37,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,400 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689333275842Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689333277342 (+1500 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689333277342Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689333277343 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689333277350 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689333277361 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689333277400 (+39 ms) 2023-07-14 11:14:37,404 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:37,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.5610 sec 2023-07-14 11:14:37,949 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:37,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:37,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:37,951 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951 2023-07-14 11:14:37,951 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45973, tgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951, rawTgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:37,980 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:37,980 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-341980445_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:37,980 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 11:14:37,995 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:38,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:38,115 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,115 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,115 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,213 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-8523942032414223486.jar 2023-07-14 11:14:38,213 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,214 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,214 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,215 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,215 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,216 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:38,216 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:38,216 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:38,217 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:38,217 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:38,218 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:38,218 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:38,219 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:38,219 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:38,220 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:38,220 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:38,221 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:38,221 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:38,222 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:38,248 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:38,248 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:38,249 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:38,250 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:39,050 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:40,306 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:40,308 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 11:14:40,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:40,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:40,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:46,631 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:49,699 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:14:49,701 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:14:49,726 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:49,726 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:14:49,727 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:14:49,727 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:49,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 11:14:49,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 11:14:49,729 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:49,730 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 11:14:49,730 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333277951/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 11:14:49,755 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 11:14:49,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 11:14:49,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:49,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:49,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333289761"}]},"ts":"1689333289761"} 2023-07-14 11:14:49,762 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 11:14:49,766 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 11:14:49,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, UNASSIGN}] 2023-07-14 11:14:49,769 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, UNASSIGN 2023-07-14 11:14:49,769 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, UNASSIGN 2023-07-14 11:14:49,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=996f6bcbb2b4a11e5948c387cccc693d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:49,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8fcb1f4772b2e176c98acfa337b04b6c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:49,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333289770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333289770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333289770"}]},"ts":"1689333289770"} 2023-07-14 11:14:49,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333289770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333289770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333289770"}]},"ts":"1689333289770"} 2023-07-14 11:14:49,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 996f6bcbb2b4a11e5948c387cccc693d, server=jenkins-hbase9.apache.org,45073,1689333142586}] 2023-07-14 11:14:49,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 8fcb1f4772b2e176c98acfa337b04b6c, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:49,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:49,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:49,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 996f6bcbb2b4a11e5948c387cccc693d, disabling compactions & flushes 2023-07-14 11:14:49,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:49,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:49,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. after waiting 0 ms 2023-07-14 11:14:49,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:49,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8fcb1f4772b2e176c98acfa337b04b6c, disabling compactions & flushes 2023-07-14 11:14:49,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. after waiting 0 ms 2023-07-14 11:14:49,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:49,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:49,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:49,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d. 2023-07-14 11:14:49,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 996f6bcbb2b4a11e5948c387cccc693d: 2023-07-14 11:14:49,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:49,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:49,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=996f6bcbb2b4a11e5948c387cccc693d, regionState=CLOSED 2023-07-14 11:14:49,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333289948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333289948"}]},"ts":"1689333289948"} 2023-07-14 11:14:49,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:49,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c. 2023-07-14 11:14:49,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8fcb1f4772b2e176c98acfa337b04b6c: 2023-07-14 11:14:49,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:49,960 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8fcb1f4772b2e176c98acfa337b04b6c, regionState=CLOSED 2023-07-14 11:14:49,961 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333289960"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333289960"}]},"ts":"1689333289960"} 2023-07-14 11:14:49,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 11:14:49,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 996f6bcbb2b4a11e5948c387cccc693d, server=jenkins-hbase9.apache.org,45073,1689333142586 in 180 msec 2023-07-14 11:14:49,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=996f6bcbb2b4a11e5948c387cccc693d, UNASSIGN in 195 msec 2023-07-14 11:14:49,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 11:14:49,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 8fcb1f4772b2e176c98acfa337b04b6c, server=jenkins-hbase9.apache.org,45261,1689333142675 in 190 msec 2023-07-14 11:14:49,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 11:14:49,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fcb1f4772b2e176c98acfa337b04b6c, UNASSIGN in 199 msec 2023-07-14 11:14:49,968 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333289968"}]},"ts":"1689333289968"} 2023-07-14 11:14:49,969 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 11:14:49,971 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 11:14:49,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 216 msec 2023-07-14 11:14:50,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:50,063 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 11:14:50,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,068 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,069 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,076 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,076 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,076 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,076 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:50,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:50,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:50,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,079 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,078 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,079 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 11:14:50,092 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:50,092 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:50,096 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/recovered.edits] 2023-07-14 11:14:50,096 DEBUG [HFileArchiver-25] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/recovered.edits] 2023-07-14 11:14:50,106 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/cf/e1a66b87da3a4cf78c8b3aca853b941e 2023-07-14 11:14:50,112 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c/recovered.edits/9.seqid 2023-07-14 11:14:50,112 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fcb1f4772b2e176c98acfa337b04b6c 2023-07-14 11:14:50,120 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/cf/754ea712cec9422da668fc2aba67717a 2023-07-14 11:14:50,126 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d/recovered.edits/9.seqid 2023-07-14 11:14:50,131 DEBUG [HFileArchiver-25] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testEmptyExportFileSystemState/996f6bcbb2b4a11e5948c387cccc693d 2023-07-14 11:14:50,131 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 11:14:50,132 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 11:14:50,133 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-14 11:14:50,138 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307149894cc4f78bd417e84a79bef4d4b410b 2023-07-14 11:14:50,139 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714281d0235c42a4abca5a9863a456e594e 2023-07-14 11:14:50,141 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 11:14:50,144 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,148 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 11:14:50,165 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 11:14:50,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 11:14:50,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333290167"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:50,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333290167"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:50,175 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:14:50,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 996f6bcbb2b4a11e5948c387cccc693d, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274239.996f6bcbb2b4a11e5948c387cccc693d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fcb1f4772b2e176c98acfa337b04b6c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274239.8fcb1f4772b2e176c98acfa337b04b6c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:14:50,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 11:14:50,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333290176"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:50,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 11:14:50,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 11:14:50,182 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:50,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 118 msec 2023-07-14 11:14:50,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 11:14:50,382 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 11:14:50,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 11:14:50,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:50,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 11:14:50,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:50,428 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1839006732_1 at /127.0.0.1:57162 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:45040 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1546218667_17 at /127.0.0.1:57188 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:34827 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4915 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x234760f4-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1121854974_17 at /127.0.0.1:34642 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x234760f4-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase9.apache.org/172.31.2.10:37509 from appattempt_1689333153000_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=914 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1462 (was 1447) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 192), AvailableMemoryMB=2454 (was 1091) - AvailableMemoryMB LEAK? - 2023-07-14 11:14:50,428 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 11:14:50,456 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=1462, ProcessCount=187, AvailableMemoryMB=2448 2023-07-14 11:14:50,457 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 11:14:50,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 11:14:50,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:50,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 11:14:50,464 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:50,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:50,467 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,467 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,468 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 empty. 2023-07-14 11:14:50,468 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a empty. 2023-07-14 11:14:50,468 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,468 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,468 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 11:14:50,479 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:50,480 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a3d39f7c353836768647adc3480b283a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:50,480 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45f289c2927198b44eabe5510c3c0349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 45f289c2927198b44eabe5510c3c0349, disabling compactions & flushes 2023-07-14 11:14:50,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. after waiting 0 ms 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 45f289c2927198b44eabe5510c3c0349: 2023-07-14 11:14:50,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a3d39f7c353836768647adc3480b283a, disabling compactions & flushes 2023-07-14 11:14:50,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. after waiting 0 ms 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a3d39f7c353836768647adc3480b283a: 2023-07-14 11:14:50,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:50,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333290579"}]},"ts":"1689333290579"} 2023-07-14 11:14:50,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333290579"}]},"ts":"1689333290579"} 2023-07-14 11:14:50,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:50,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:50,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333290586"}]},"ts":"1689333290586"} 2023-07-14 11:14:50,588 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 11:14:50,591 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:50,593 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:50,593 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:50,593 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:50,593 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:50,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, ASSIGN}] 2023-07-14 11:14:50,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, ASSIGN 2023-07-14 11:14:50,600 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, ASSIGN 2023-07-14 11:14:50,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33095,1689333142453; forceNewPlan=false, retain=false 2023-07-14 11:14:50,601 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45261,1689333142675; forceNewPlan=false, retain=false 2023-07-14 11:14:50,751 INFO [jenkins-hbase9:34219] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:50,754 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45f289c2927198b44eabe5510c3c0349, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:50,754 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a3d39f7c353836768647adc3480b283a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:50,754 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333290754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333290754"}]},"ts":"1689333290754"} 2023-07-14 11:14:50,755 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333290754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333290754"}]},"ts":"1689333290754"} 2023-07-14 11:14:50,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure a3d39f7c353836768647adc3480b283a, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:14:50,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 45f289c2927198b44eabe5510c3c0349, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:14:50,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:50,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3d39f7c353836768647adc3480b283a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45f289c2927198b44eabe5510c3c0349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. service=AccessControlService 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. service=AccessControlService 2023-07-14 11:14:50,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:50,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:50,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,919 INFO [StoreOpener-45f289c2927198b44eabe5510c3c0349-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,920 INFO [StoreOpener-a3d39f7c353836768647adc3480b283a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,920 DEBUG [StoreOpener-45f289c2927198b44eabe5510c3c0349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf 2023-07-14 11:14:50,921 DEBUG [StoreOpener-45f289c2927198b44eabe5510c3c0349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf 2023-07-14 11:14:50,921 DEBUG [StoreOpener-a3d39f7c353836768647adc3480b283a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf 2023-07-14 11:14:50,921 DEBUG [StoreOpener-a3d39f7c353836768647adc3480b283a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf 2023-07-14 11:14:50,921 INFO [StoreOpener-45f289c2927198b44eabe5510c3c0349-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45f289c2927198b44eabe5510c3c0349 columnFamilyName cf 2023-07-14 11:14:50,921 INFO [StoreOpener-a3d39f7c353836768647adc3480b283a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3d39f7c353836768647adc3480b283a columnFamilyName cf 2023-07-14 11:14:50,922 INFO [StoreOpener-45f289c2927198b44eabe5510c3c0349-1] regionserver.HStore(310): Store=45f289c2927198b44eabe5510c3c0349/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:50,923 INFO [StoreOpener-a3d39f7c353836768647adc3480b283a-1] regionserver.HStore(310): Store=a3d39f7c353836768647adc3480b283a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:50,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:14:50,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a3d39f7c353836768647adc3480b283a 2023-07-14 11:14:50,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:50,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:50,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 45f289c2927198b44eabe5510c3c0349; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66227515, jitterRate=-0.013133123517036438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:50,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a3d39f7c353836768647adc3480b283a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73748076, jitterRate=0.09893196821212769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:50,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 45f289c2927198b44eabe5510c3c0349: 2023-07-14 11:14:50,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a3d39f7c353836768647adc3480b283a: 2023-07-14 11:14:50,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a., pid=108, masterSystemTime=1689333290910 2023-07-14 11:14:50,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349., pid=109, masterSystemTime=1689333290910 2023-07-14 11:14:50,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:50,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a3d39f7c353836768647adc3480b283a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:50,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290936"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333290936"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333290936"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333290936"}]},"ts":"1689333290936"} 2023-07-14 11:14:50,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:50,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45f289c2927198b44eabe5510c3c0349, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:50,937 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333290937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333290937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333290937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333290937"}]},"ts":"1689333290937"} 2023-07-14 11:14:50,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-14 11:14:50,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure a3d39f7c353836768647adc3480b283a, server=jenkins-hbase9.apache.org,33095,1689333142453 in 181 msec 2023-07-14 11:14:50,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-14 11:14:50,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 45f289c2927198b44eabe5510c3c0349, server=jenkins-hbase9.apache.org,45261,1689333142675 in 181 msec 2023-07-14 11:14:50,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, ASSIGN in 347 msec 2023-07-14 11:14:50,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 11:14:50,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, ASSIGN in 348 msec 2023-07-14 11:14:50,943 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:50,943 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333290943"}]},"ts":"1689333290943"} 2023-07-14 11:14:50,944 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 11:14:50,947 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:50,947 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 11:14:50,948 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:50,950 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,950 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,950 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,950 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:50,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:50,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:50,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:50,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:50,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 495 msec 2023-07-14 11:14:51,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:51,069 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 11:14:51,071 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,071 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:51,073 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:51,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333291092 (current time:1689333291092). 2023-07-14 11:14:51,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:51,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x5f3970f1 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:51,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48a409fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:51,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,123 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f3970f1 to 127.0.0.1:51121 2023-07-14 11:14:51,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:51,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x71b1d4e1 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:51,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@651b9cde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:51,150 DEBUG [hconnection-0xd189268-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,153 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,162 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71b1d4e1 to 127.0.0.1:51121 2023-07-14 11:14:51,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:51,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:51,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:51,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,169 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,170 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689333891170 2023-07-14 11:14:51,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,171 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:51,172 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:51,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:51,175 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-14 11:14:51,180 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:51,183 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689333891183 2023-07-14 11:14:51,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,205 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:51,205 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,212 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 11:14:51,212 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 11:14:51,213 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,213 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,214 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,214 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,214 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,214 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,215 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,215 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,215 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,215 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:51,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,217 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,217 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,222 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,222 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,223 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,224 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,224 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,227 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,227 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,227 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,228 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,228 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,228 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,228 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,229 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,229 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,229 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,229 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,229 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,230 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,230 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:51,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:51,236 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 11:14:51,236 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,237 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,237 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,237 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:51,237 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,238 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,238 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:51,238 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:51,238 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:51,238 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. started... 2023-07-14 11:14:51,239 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45f289c2927198b44eabe5510c3c0349: 2023-07-14 11:14:51,239 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,239 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:51,239 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:51,240 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:51,240 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:51,240 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:51,249 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. started... 2023-07-14 11:14:51,240 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,253 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,253 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3d39f7c353836768647adc3480b283a: 2023-07-14 11:14:51,253 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:51,253 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,253 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:51,253 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:51,254 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:51,272 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:51,273 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:51,369 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. completed. 2023-07-14 11:14:51,369 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:51,370 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:51,370 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:51,370 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,370 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:51,370 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:51,371 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,372 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,372 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:51,372 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:51,373 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. completed. 2023-07-14 11:14:51,373 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:51,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,373 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:51,374 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:51,374 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,374 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:51,374 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,375 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,375 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,376 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:51,376 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:51,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 11:14:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:14:51,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 11:14:51,387 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 11:14:51,387 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:51,387 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:51,387 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,387 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:51,389 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,389 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,390 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,390 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,389 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,390 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,391 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,392 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,392 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,397 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,398 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,398 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,407 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,409 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,409 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:51,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:51,413 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,414 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:51,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 11:14:51,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,474 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:51,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:51,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:51,476 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:51,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 11:14:51,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689333291170Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689333291442 (+272 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333291442Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333291442Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333291448 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333291473 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689333291557 (+84 ms) 2023-07-14 11:14:51,563 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:51,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 392 msec 2023-07-14 11:14:51,776 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:51,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:51,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:51,780 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45261] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:51,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33095] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:51,788 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,788 DEBUG [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:51,789 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:51,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333291804 (current time:1689333291804). 2023-07-14 11:14:51,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:51,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x469922c9 to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:51,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f5b73a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:51,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,820 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x469922c9 to 127.0.0.1:51121 2023-07-14 11:14:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(139): Connect 0x3e52cdfd to 127.0.0.1:51121 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:51,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31523f94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:51,842 DEBUG [hconnection-0x65408c6d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,847 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:51,855 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:51,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e52cdfd to 127.0.0.1:51121 2023-07-14 11:14:51,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:51,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:51,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:51,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,862 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,863 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689333891863 2023-07-14 11:14:51,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:51,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,865 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:51,865 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:51,866 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:51,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:51,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-14 11:14:51,867 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:51,868 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689333891868 2023-07-14 11:14:51,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,937 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:51,937 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,942 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 11:14:51,942 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 11:14:51,942 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,943 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,944 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,944 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,944 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,944 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:51,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,946 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,946 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:51,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,966 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:51,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:51,968 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:51,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,974 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45073,1689333142586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:51,976 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,978 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:51,978 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:51,978 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:51,980 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,981 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,981 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,982 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,982 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,982 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,982 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,982 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,984 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,984 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,984 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:51,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45261,1689333142675' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8a81b2a[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:51,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:51,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:51,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:51,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33095,1689333142453' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:51,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8a81b2a[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:51,992 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 11:14:51,992 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,995 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,996 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:51,996 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:51,996 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,996 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:51,996 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:51,996 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45073,1689333142586' in zk 2023-07-14 11:14:51,996 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:51,997 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:51,998 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:51,998 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:51,998 DEBUG [member: 'jenkins-hbase9.apache.org,45073,1689333142586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:52,017 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:52,018 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:52,018 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:52,019 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. started... 2023-07-14 11:14:52,020 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45f289c2927198b44eabe5510c3c0349 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-14 11:14:52,020 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:52,021 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:52,021 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:52,021 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. started... 2023-07-14 11:14:52,021 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a3d39f7c353836768647adc3480b283a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-14 11:14:52,139 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593 2023-07-14 11:14:52,142 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79 2023-07-14 11:14:52,168 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:52,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:52,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:52,169 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:52,215 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/.tmp/cf/e279281644ae4fe688e12a14b300e3b0 2023-07-14 11:14:52,226 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/.tmp/cf/6799f53674fb41b2a44f5f9d535e9813 2023-07-14 11:14:52,239 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/.tmp/cf/e279281644ae4fe688e12a14b300e3b0 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0 2023-07-14 11:14:52,241 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/.tmp/cf/6799f53674fb41b2a44f5f9d535e9813 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813 2023-07-14 11:14:52,245 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0, entries=49, sequenceid=6, filesize=13.7 K 2023-07-14 11:14:52,248 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813, entries=1, sequenceid=6, filesize=5.1 K 2023-07-14 11:14:52,251 INFO [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for a3d39f7c353836768647adc3480b283a in 230ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:52,251 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:52,251 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3d39f7c353836768647adc3480b283a: 2023-07-14 11:14:52,252 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,252 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:52,252 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0] hfiles 2023-07-14 11:14:52,252 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,254 INFO [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 45f289c2927198b44eabe5510c3c0349 in 234ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:52,256 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45f289c2927198b44eabe5510c3c0349: 2023-07-14 11:14:52,256 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,256 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:52,256 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813] hfiles 2023-07-14 11:14:52,256 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,337 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. completed. 2023-07-14 11:14:52,337 DEBUG [rs(jenkins-hbase9.apache.org,45261,1689333142675)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:14:52,337 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:52,337 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:52,337 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,337 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:52,337 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45261,1689333142675' in zk 2023-07-14 11:14:52,340 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:52,340 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:52,340 DEBUG [member: 'jenkins-hbase9.apache.org,45261,1689333142675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:52,342 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:52,344 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. completed. 2023-07-14 11:14:52,344 DEBUG [rs(jenkins-hbase9.apache.org,33095,1689333142453)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:14:52,344 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:52,344 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:52,344 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,344 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:52,344 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33095,1689333142453' in zk 2023-07-14 11:14:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,348 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,348 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:52,348 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:52,348 DEBUG [member: 'jenkins-hbase9.apache.org,33095,1689333142453' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45261,1689333142675': 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45261,1689333142675' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,33095,1689333142453': 2023-07-14 11:14:52,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33095,1689333142453' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 11:14:52,357 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 11:14:52,357 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:52,357 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:52,357 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,357 INFO [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:52,361 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,361 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,362 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,364 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:52,365 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,365 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,375 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:52,375 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:52,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:52,375 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:52,375 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:52,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,376 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:52,377 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:52,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:52,377 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,377 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,377 DEBUG [(jenkins-hbase9.apache.org,34219,1689333140818)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:52,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,377 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:52,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 11:14:52,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,380 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79] mob files 2023-07-14 11:14:52,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593 2023-07-14 11:14:52,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79 2023-07-14 11:14:52,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 11:14:52,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,463 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689333291863Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689333292390 (+527 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689333292390Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689333292391 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689333292406 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689333292433 (+27 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689333292463 (+30 ms) 2023-07-14 11:14:52,466 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:52,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 601 msec 2023-07-14 11:14:52,470 DEBUG [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:52,471 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471 2023-07-14 11:14:52,471 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45973, tgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471, rawTgtDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471, srcFsUri=hdfs://localhost:45973, srcDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:52,496 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729 2023-07-14 11:14:52,497 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493580807_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,497 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45973, inputRoot=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729, snapshotDir=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 11:14:52,510 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:52,547 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,547 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,548 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,548 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,549 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,549 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,549 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,634 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/hadoop-1666579694259155770.jar 2023-07-14 11:14:52,634 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,634 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,635 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,635 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,635 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,635 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:52,636 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:52,636 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:52,637 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:52,637 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:52,637 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:52,638 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:52,638 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:52,638 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:52,639 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:52,639 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:52,639 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:52,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:52,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:52,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:52,640 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:52,641 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:52,641 DEBUG [Listener at jenkins-hbase9.apache.org/44573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:53,339 WARN [Listener at jenkins-hbase9.apache.org/44573] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:53,342 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 11:14:53,345 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-14 11:14:54,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:54,092 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:54,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:55,067 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0007_000001 (auth:SIMPLE) 2023-07-14 11:14:55,541 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:15:02,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:05,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:09,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153000_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:10,756 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:15:10,756 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:15:10,769 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,769 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:15:10,770 INFO [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:15:10,770 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 11:15:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 11:15:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1546218667_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 11:15:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/44573] snapshot.TestExportSnapshot(367): hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/export-test/export-1689333292471/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 11:15:10,778 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:10,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:10,783 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333310783"}]},"ts":"1689333310783"} 2023-07-14 11:15:10,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 11:15:10,787 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 11:15:10,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, UNASSIGN}] 2023-07-14 11:15:10,789 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, UNASSIGN 2023-07-14 11:15:10,789 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, UNASSIGN 2023-07-14 11:15:10,790 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45f289c2927198b44eabe5510c3c0349, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:15:10,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a3d39f7c353836768647adc3480b283a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:15:10,790 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333310790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333310790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333310790"}]},"ts":"1689333310790"} 2023-07-14 11:15:10,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333310790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333310790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333310790"}]},"ts":"1689333310790"} 2023-07-14 11:15:10,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 45f289c2927198b44eabe5510c3c0349, server=jenkins-hbase9.apache.org,45261,1689333142675}] 2023-07-14 11:15:10,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a3d39f7c353836768647adc3480b283a, server=jenkins-hbase9.apache.org,33095,1689333142453}] 2023-07-14 11:15:10,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:10,911 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase9.apache.org,45261,1689333142675, timeout=1689333310943, delay=32, operations=[pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 45f289c2927198b44eabe5510c3c0349, server=jenkins-hbase9.apache.org,45261,1689333142675], containedObject=jenkins-hbase9.apache.org,33095,1689333142453, timeout=1689333310944, delay=33, operations=[pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a3d39f7c353836768647adc3480b283a, server=jenkins-hbase9.apache.org,33095,1689333142453]] 2023-07-14 11:15:10,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:15:10,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 45f289c2927198b44eabe5510c3c0349, disabling compactions & flushes 2023-07-14 11:15:10,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:15:10,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:15:10,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. after waiting 0 ms 2023-07-14 11:15:10,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:15:10,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a3d39f7c353836768647adc3480b283a 2023-07-14 11:15:10,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a3d39f7c353836768647adc3480b283a, disabling compactions & flushes 2023-07-14 11:15:10,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:15:10,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:15:10,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. after waiting 0 ms 2023-07-14 11:15:10,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:15:10,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:10,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:10,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:10,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:10,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a. 2023-07-14 11:15:10,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349. 2023-07-14 11:15:10,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a3d39f7c353836768647adc3480b283a: 2023-07-14 11:15:10,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 45f289c2927198b44eabe5510c3c0349: 2023-07-14 11:15:10,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=45f289c2927198b44eabe5510c3c0349, regionState=CLOSED 2023-07-14 11:15:10,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333310973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333310973"}]},"ts":"1689333310973"} 2023-07-14 11:15:10,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a3d39f7c353836768647adc3480b283a, regionState=CLOSED 2023-07-14 11:15:10,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333310974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333310974"}]},"ts":"1689333310974"} 2023-07-14 11:15:10,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 45f289c2927198b44eabe5510c3c0349 2023-07-14 11:15:10,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a3d39f7c353836768647adc3480b283a 2023-07-14 11:15:10,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 11:15:10,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 45f289c2927198b44eabe5510c3c0349, server=jenkins-hbase9.apache.org,45261,1689333142675 in 184 msec 2023-07-14 11:15:10,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=45f289c2927198b44eabe5510c3c0349, UNASSIGN in 190 msec 2023-07-14 11:15:10,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 11:15:10,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure a3d39f7c353836768647adc3480b283a, server=jenkins-hbase9.apache.org,33095,1689333142453 in 189 msec 2023-07-14 11:15:10,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-14 11:15:10,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a3d39f7c353836768647adc3480b283a, UNASSIGN in 195 msec 2023-07-14 11:15:10,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333310984"}]},"ts":"1689333310984"} 2023-07-14 11:15:10,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 11:15:10,986 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 11:15:10,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 209 msec 2023-07-14 11:15:11,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:11,085 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 11:15:11,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,089 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,090 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,091 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45261] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,094 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,094 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,095 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,095 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:15:11,094 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,095 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:15:11,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 11:15:11,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 11:15:11,096 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:15:11,096 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:11,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 11:15:11,098 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/recovered.edits] 2023-07-14 11:15:11,098 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf, FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/recovered.edits] 2023-07-14 11:15:11,102 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/cf/6799f53674fb41b2a44f5f9d535e9813 2023-07-14 11:15:11,103 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/cf/e279281644ae4fe688e12a14b300e3b0 2023-07-14 11:15:11,107 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349/recovered.edits/9.seqid 2023-07-14 11:15:11,107 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/recovered.edits/9.seqid to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a/recovered.edits/9.seqid 2023-07-14 11:15:11,107 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/45f289c2927198b44eabe5510c3c0349 2023-07-14 11:15:11,107 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a3d39f7c353836768647adc3480b283a 2023-07-14 11:15:11,107 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 11:15:11,108 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 11:15:11,109 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-14 11:15:11,113 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071479fa2b21660a4af48038ed970029d593 2023-07-14 11:15:11,115 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79 to hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714c4175893dfe54a738ea8e087dc790d79 2023-07-14 11:15:11,115 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 11:15:11,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,119 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 11:15:11,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 11:15:11,133 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,133 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 11:15:11,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333311133"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:11,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333311133"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:11,137 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:15:11,137 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45f289c2927198b44eabe5510c3c0349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333290458.45f289c2927198b44eabe5510c3c0349.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a3d39f7c353836768647adc3480b283a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333290458.a3d39f7c353836768647adc3480b283a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:15:11,137 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 11:15:11,137 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333311137"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:11,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 11:15:11,146 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 60 msec 2023-07-14 11:15:11,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 11:15:11,199 INFO [Listener at jenkins-hbase9.apache.org/44573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 11:15:11,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 11:15:11,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 11:15:11,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34219] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:11,235 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 763), OpenFileDescriptor=899 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1426 (was 1462), ProcessCount=187 (was 187), AvailableMemoryMB=1634 (was 2448) 2023-07-14 11:15:11,235 WARN [Listener at jenkins-hbase9.apache.org/44573] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 11:15:11,235 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 11:15:11,245 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:11,356 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689333153000_0007_01_000001 is : 143 2023-07-14 11:15:16,576 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:15:25,387 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:39,511 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:39,511 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:39,628 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 11:15:39,642 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 11:15:39,643 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:39,663 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:39,769 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:39,769 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 11:15:39,769 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 11:15:39,769 INFO [Listener at jenkins-hbase9.apache.org/44573] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 11:15:39,769 DEBUG [Listener at jenkins-hbase9.apache.org/44573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31248683 to 127.0.0.1:51121 2023-07-14 11:15:39,769 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:39,770 DEBUG [Listener at jenkins-hbase9.apache.org/44573] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 11:15:39,770 DEBUG [Listener at jenkins-hbase9.apache.org/44573] util.JVMClusterUtil(257): Found active master hash=1292613079, stopped=false 2023-07-14 11:15:39,770 DEBUG [Listener at jenkins-hbase9.apache.org/44573] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:39,770 DEBUG [Listener at jenkins-hbase9.apache.org/44573] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 11:15:39,770 INFO [Listener at jenkins-hbase9.apache.org/44573] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:15:39,772 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:39,772 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:39,772 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:39,772 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:15:39,772 INFO [Listener at jenkins-hbase9.apache.org/44573] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 11:15:39,772 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:39,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:39,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:39,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:39,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:39,773 DEBUG [Listener at jenkins-hbase9.apache.org/44573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x200f6222 to 127.0.0.1:51121 2023-07-14 11:15:39,773 DEBUG [Listener at jenkins-hbase9.apache.org/44573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:39,773 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33095,1689333142453' ***** 2023-07-14 11:15:39,773 DEBUG [Listener at jenkins-hbase9.apache.org/44573] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:39,773 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:39,774 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45073,1689333142586' ***** 2023-07-14 11:15:39,774 DEBUG [Listener at jenkins-hbase9.apache.org/44573] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:39,774 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:39,774 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45261,1689333142675' ***** 2023-07-14 11:15:39,774 DEBUG [Listener at jenkins-hbase9.apache.org/44573] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:39,774 INFO [RS:0;jenkins-hbase9:33095] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:39,774 INFO [RS:1;jenkins-hbase9:45073] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:39,774 INFO [RS:0;jenkins-hbase9:33095] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:39,774 INFO [Listener at jenkins-hbase9.apache.org/44573] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:39,775 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:39,775 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:39,775 INFO [RS:2;jenkins-hbase9:45261] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:39,775 INFO [RS:2;jenkins-hbase9:45261] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:39,775 INFO [RS:2;jenkins-hbase9:45261] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:39,775 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(3305): Received CLOSE for 1ce932c1300553e884788b15821702aa 2023-07-14 11:15:39,775 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:15:39,776 DEBUG [RS:2;jenkins-hbase9:45261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bae4b76 to 127.0.0.1:51121 2023-07-14 11:15:39,776 DEBUG [RS:2;jenkins-hbase9:45261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:39,775 INFO [RS:0;jenkins-hbase9:33095] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:39,777 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:15:39,777 DEBUG [RS:0;jenkins-hbase9:33095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68820076 to 127.0.0.1:51121 2023-07-14 11:15:39,777 DEBUG [RS:0;jenkins-hbase9:33095] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:39,779 INFO [RS:0;jenkins-hbase9:33095] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:39,780 INFO [RS:0;jenkins-hbase9:33095] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:39,780 INFO [RS:0;jenkins-hbase9:33095] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:39,780 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 11:15:39,774 INFO [RS:1;jenkins-hbase9:45073] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:39,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1ce932c1300553e884788b15821702aa, disabling compactions & flushes 2023-07-14 11:15:39,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:15:39,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:15:39,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. after waiting 0 ms 2023-07-14 11:15:39,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:15:39,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1ce932c1300553e884788b15821702aa 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 11:15:39,777 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 11:15:39,782 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1478): Online Regions={1ce932c1300553e884788b15821702aa=hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa.} 2023-07-14 11:15:39,783 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1504): Waiting on 1ce932c1300553e884788b15821702aa 2023-07-14 11:15:39,777 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:39,781 INFO [RS:1;jenkins-hbase9:45073] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:39,791 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 11:15:39,791 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-14 11:15:39,791 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:39,792 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(3305): Received CLOSE for 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:15:39,792 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:15:39,792 DEBUG [RS:1;jenkins-hbase9:45073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x777cc29e to 127.0.0.1:51121 2023-07-14 11:15:39,792 DEBUG [RS:1;jenkins-hbase9:45073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:39,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5881ad6a3f9cfe7bba8d58ba83d1ff70, disabling compactions & flushes 2023-07-14 11:15:39,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:15:39,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:15:39,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. after waiting 0 ms 2023-07-14 11:15:39,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:15:39,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 5881ad6a3f9cfe7bba8d58ba83d1ff70 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 11:15:39,801 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:39,802 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:39,810 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 11:15:39,810 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 11:15:39,810 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1478): Online Regions={5881ad6a3f9cfe7bba8d58ba83d1ff70=hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70.} 2023-07-14 11:15:39,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 11:15:39,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 11:15:39,811 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1504): Waiting on 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:15:39,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 11:15:39,811 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 11:15:39,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 11:15:39,865 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:39,983 DEBUG [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1504): Waiting on 1ce932c1300553e884788b15821702aa 2023-07-14 11:15:39,992 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:40,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/.tmp/l/b6efcb92ccef407c93494d01c57f69d5 2023-07-14 11:15:40,012 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1504): Waiting on 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:15:40,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6efcb92ccef407c93494d01c57f69d5 2023-07-14 11:15:40,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/.tmp/l/b6efcb92ccef407c93494d01c57f69d5 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/l/b6efcb92ccef407c93494d01c57f69d5 2023-07-14 11:15:40,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/info/321c2df8ccc0435a818590e57e3775be 2023-07-14 11:15:40,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6efcb92ccef407c93494d01c57f69d5 2023-07-14 11:15:40,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/l/b6efcb92ccef407c93494d01c57f69d5, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 11:15:40,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 321c2df8ccc0435a818590e57e3775be 2023-07-14 11:15:40,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1ce932c1300553e884788b15821702aa in 331ms, sequenceid=18, compaction requested=false 2023-07-14 11:15:40,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/acl/1ce932c1300553e884788b15821702aa/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 11:15:40,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:40,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:15:40,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1ce932c1300553e884788b15821702aa: 2023-07-14 11:15:40,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689333147299.1ce932c1300553e884788b15821702aa. 2023-07-14 11:15:40,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/rep_barrier/38099d263beb410da8437e1eb90cdd9c 2023-07-14 11:15:40,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38099d263beb410da8437e1eb90cdd9c 2023-07-14 11:15:40,183 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45261,1689333142675; all regions closed. 2023-07-14 11:15:40,192 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:40,210 DEBUG [RS:2;jenkins-hbase9:45261] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs 2023-07-14 11:15:40,210 INFO [RS:2;jenkins-hbase9:45261] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45261%2C1689333142675:(num 1689333145629) 2023-07-14 11:15:40,210 DEBUG [RS:2;jenkins-hbase9:45261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:40,210 INFO [RS:2;jenkins-hbase9:45261] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:40,210 INFO [RS:2;jenkins-hbase9:45261] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:40,210 INFO [RS:2;jenkins-hbase9:45261] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:40,210 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:40,210 INFO [RS:2;jenkins-hbase9:45261] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:40,211 INFO [RS:2;jenkins-hbase9:45261] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:40,212 INFO [RS:2;jenkins-hbase9:45261] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45261 2023-07-14 11:15:40,213 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1504): Waiting on 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45261,1689333142675 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,217 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,219 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45261,1689333142675] 2023-07-14 11:15:40,220 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45261,1689333142675; numProcessing=1 2023-07-14 11:15:40,221 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45261,1689333142675 already deleted, retry=false 2023-07-14 11:15:40,221 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45261,1689333142675 expired; onlineServers=2 2023-07-14 11:15:40,320 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,320 INFO [RS:2;jenkins-hbase9:45261] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45261,1689333142675; zookeeper connection closed. 2023-07-14 11:15:40,320 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45261-0x101637acd630003, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,322 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@477814e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@477814e0 2023-07-14 11:15:40,359 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 11:15:40,359 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 11:15:40,392 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:40,413 DEBUG [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1504): Waiting on 5881ad6a3f9cfe7bba8d58ba83d1ff70 2023-07-14 11:15:40,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/.tmp/info/63141504f0aa46ce97c64126caf5348e 2023-07-14 11:15:40,432 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 11:15:40,432 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 11:15:40,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/.tmp/info/63141504f0aa46ce97c64126caf5348e as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/info/63141504f0aa46ce97c64126caf5348e 2023-07-14 11:15:40,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/info/63141504f0aa46ce97c64126caf5348e, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 11:15:40,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5881ad6a3f9cfe7bba8d58ba83d1ff70 in 645ms, sequenceid=6, compaction requested=false 2023-07-14 11:15:40,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/namespace/5881ad6a3f9cfe7bba8d58ba83d1ff70/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:40,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:40,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:15:40,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5881ad6a3f9cfe7bba8d58ba83d1ff70: 2023-07-14 11:15:40,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689333146337.5881ad6a3f9cfe7bba8d58ba83d1ff70. 2023-07-14 11:15:40,592 DEBUG [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:40,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/table/f6f15bb8f9e44dd18691c2ed674482b8 2023-07-14 11:15:40,613 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45073,1689333142586; all regions closed. 2023-07-14 11:15:40,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6f15bb8f9e44dd18691c2ed674482b8 2023-07-14 11:15:40,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/info/321c2df8ccc0435a818590e57e3775be as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/info/321c2df8ccc0435a818590e57e3775be 2023-07-14 11:15:40,621 DEBUG [RS:1;jenkins-hbase9:45073] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs 2023-07-14 11:15:40,621 INFO [RS:1;jenkins-hbase9:45073] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45073%2C1689333142586:(num 1689333145630) 2023-07-14 11:15:40,621 DEBUG [RS:1;jenkins-hbase9:45073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:40,621 INFO [RS:1;jenkins-hbase9:45073] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:40,622 INFO [RS:1;jenkins-hbase9:45073] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:40,622 INFO [RS:1;jenkins-hbase9:45073] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:40,623 INFO [RS:1;jenkins-hbase9:45073] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:40,623 INFO [RS:1;jenkins-hbase9:45073] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:40,622 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:40,623 INFO [RS:1;jenkins-hbase9:45073] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45073 2023-07-14 11:15:40,625 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:15:40,626 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45073,1689333142586 2023-07-14 11:15:40,626 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 321c2df8ccc0435a818590e57e3775be 2023-07-14 11:15:40,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/info/321c2df8ccc0435a818590e57e3775be, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 11:15:40,626 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45073,1689333142586] 2023-07-14 11:15:40,626 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45073,1689333142586; numProcessing=2 2023-07-14 11:15:40,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/rep_barrier/38099d263beb410da8437e1eb90cdd9c as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/rep_barrier/38099d263beb410da8437e1eb90cdd9c 2023-07-14 11:15:40,631 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45073,1689333142586 already deleted, retry=false 2023-07-14 11:15:40,632 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45073,1689333142586 expired; onlineServers=1 2023-07-14 11:15:40,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38099d263beb410da8437e1eb90cdd9c 2023-07-14 11:15:40,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/rep_barrier/38099d263beb410da8437e1eb90cdd9c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 11:15:40,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/.tmp/table/f6f15bb8f9e44dd18691c2ed674482b8 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/table/f6f15bb8f9e44dd18691c2ed674482b8 2023-07-14 11:15:40,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6f15bb8f9e44dd18691c2ed674482b8 2023-07-14 11:15:40,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/table/f6f15bb8f9e44dd18691c2ed674482b8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 11:15:40,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 839ms, sequenceid=131, compaction requested=false 2023-07-14 11:15:40,729 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,729 INFO [RS:1;jenkins-hbase9:45073] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45073,1689333142586; zookeeper connection closed. 2023-07-14 11:15:40,729 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:45073-0x101637acd630002, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,740 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53773d34] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53773d34 2023-07-14 11:15:40,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 11:15:40,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:40,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 11:15:40,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 11:15:40,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 11:15:40,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 11:15:40,793 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33095,1689333142453; all regions closed. 2023-07-14 11:15:40,814 DEBUG [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs 2023-07-14 11:15:40,814 INFO [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33095%2C1689333142453.meta:.meta(num 1689333145872) 2023-07-14 11:15:40,835 DEBUG [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/oldWALs 2023-07-14 11:15:40,835 INFO [RS:0;jenkins-hbase9:33095] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33095%2C1689333142453:(num 1689333145630) 2023-07-14 11:15:40,835 DEBUG [RS:0;jenkins-hbase9:33095] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:40,835 INFO [RS:0;jenkins-hbase9:33095] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:40,835 INFO [RS:0;jenkins-hbase9:33095] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:40,835 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:40,838 INFO [RS:0;jenkins-hbase9:33095] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33095 2023-07-14 11:15:40,840 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33095,1689333142453 2023-07-14 11:15:40,841 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:40,841 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33095,1689333142453] 2023-07-14 11:15:40,841 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33095,1689333142453; numProcessing=3 2023-07-14 11:15:40,848 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33095,1689333142453 already deleted, retry=false 2023-07-14 11:15:40,848 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33095,1689333142453 expired; onlineServers=0 2023-07-14 11:15:40,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,34219,1689333140818' ***** 2023-07-14 11:15:40,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 11:15:40,848 DEBUG [M:0;jenkins-hbase9:34219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c36bfec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,34219,1689333140818 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,34219,1689333140818; all regions closed. 2023-07-14 11:15:40,849 DEBUG [M:0;jenkins-hbase9:34219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:40,849 DEBUG [M:0;jenkins-hbase9:34219] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 11:15:40,849 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 11:15:40,849 DEBUG [M:0;jenkins-hbase9:34219] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 11:15:40,849 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145049] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145049,5,FailOnTimeoutGroup] 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 11:15:40,849 DEBUG [M:0;jenkins-hbase9:34219] master.HMaster(1512): Stopping service threads 2023-07-14 11:15:40,849 INFO [M:0;jenkins-hbase9:34219] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 11:15:40,850 ERROR [M:0;jenkins-hbase9:34219] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-26,5,PEWorkerGroup] Thread[HFileArchiver-27,5,PEWorkerGroup] 2023-07-14 11:15:40,850 INFO [M:0;jenkins-hbase9:34219] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 11:15:40,851 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 11:15:40,851 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 11:15:40,851 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:15:40,851 DEBUG [M:0;jenkins-hbase9:34219] zookeeper.ZKUtil(398): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 11:15:40,852 WARN [M:0;jenkins-hbase9:34219] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 11:15:40,852 INFO [M:0;jenkins-hbase9:34219] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 11:15:40,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:15:40,852 INFO [M:0;jenkins-hbase9:34219] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 11:15:40,852 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145046] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145046,5,FailOnTimeoutGroup] 2023-07-14 11:15:40,856 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 11:15:40,856 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:40,856 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:40,856 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 11:15:40,856 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:40,856 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.87 KB 2023-07-14 11:15:40,898 INFO [M:0;jenkins-hbase9:34219] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6e2ec29bff1c459c801c395d1f7bcd29 2023-07-14 11:15:40,905 INFO [M:0;jenkins-hbase9:34219] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e2ec29bff1c459c801c395d1f7bcd29 2023-07-14 11:15:40,906 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6e2ec29bff1c459c801c395d1f7bcd29 as hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6e2ec29bff1c459c801c395d1f7bcd29 2023-07-14 11:15:40,910 INFO [M:0;jenkins-hbase9:34219] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e2ec29bff1c459c801c395d1f7bcd29 2023-07-14 11:15:40,910 INFO [M:0;jenkins-hbase9:34219] regionserver.HStore(1080): Added hdfs://localhost:45973/user/jenkins/test-data/fb6dad08-a9b7-5862-bd0b-882f9769d729/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6e2ec29bff1c459c801c395d1f7bcd29, entries=119, sequenceid=899, filesize=28.6 K 2023-07-14 11:15:40,911 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384670, heapSize ~451.85 KB/462696, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 55ms, sequenceid=899, compaction requested=false 2023-07-14 11:15:40,913 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:40,914 DEBUG [M:0;jenkins-hbase9:34219] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:15:40,923 INFO [M:0;jenkins-hbase9:34219] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 11:15:40,923 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:40,923 INFO [M:0;jenkins-hbase9:34219] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34219 2023-07-14 11:15:40,926 DEBUG [M:0;jenkins-hbase9:34219] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,34219,1689333140818 already deleted, retry=false 2023-07-14 11:15:40,948 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,948 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): regionserver:33095-0x101637acd630001, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:40,948 INFO [RS:0;jenkins-hbase9:33095] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33095,1689333142453; zookeeper connection closed. 2023-07-14 11:15:40,950 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@775a7bd1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@775a7bd1 2023-07-14 11:15:40,951 INFO [Listener at jenkins-hbase9.apache.org/44573] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 11:15:41,015 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:41,016 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 11:15:41,016 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:41,016 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 11:15:41,016 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:41,028 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:41,028 INFO [M:0;jenkins-hbase9:34219] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,34219,1689333140818; zookeeper connection closed. 2023-07-14 11:15:41,028 DEBUG [Listener at localhost/43501-EventThread] zookeeper.ZKWatcher(600): master:34219-0x101637acd630000, quorum=127.0.0.1:51121, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:41,030 WARN [Listener at jenkins-hbase9.apache.org/44573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:41,059 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:41,163 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:41,163 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1034008582-172.31.2.10-1689333136777 (Datanode Uuid 5ca3054f-4d85-4c9b-ba86-e9d2b0aea287) service to localhost/127.0.0.1:45973 2023-07-14 11:15:41,166 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data5/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,166 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data6/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,170 WARN [Listener at jenkins-hbase9.apache.org/44573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:41,214 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:41,323 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:41,323 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1034008582-172.31.2.10-1689333136777 (Datanode Uuid f00d6b9d-33df-4ee5-9792-a22dd315775c) service to localhost/127.0.0.1:45973 2023-07-14 11:15:41,325 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data4/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,326 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data3/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,331 WARN [Listener at jenkins-hbase9.apache.org/44573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:41,351 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:41,360 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:41,360 WARN [BP-1034008582-172.31.2.10-1689333136777 heartbeating to localhost/127.0.0.1:45973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1034008582-172.31.2.10-1689333136777 (Datanode Uuid 711b9635-a200-433a-ab86-bf2dd89d3d7a) service to localhost/127.0.0.1:45973 2023-07-14 11:15:41,361 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data1/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,361 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/13b5de40-a1f2-79c5-0a68-86ed631c3941/cluster_67b0c090-384e-9051-d660-fc3bd7154be9/dfs/data/data2/current/BP-1034008582-172.31.2.10-1689333136777] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:41,427 INFO [Listener at jenkins-hbase9.apache.org/44573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:41,611 INFO [Listener at jenkins-hbase9.apache.org/44573] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 11:15:41,710 INFO [Listener at jenkins-hbase9.apache.org/44573] hbase.HBaseTestingUtility(1293): Minicluster is down